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development activities conducted under the Youth Employment and 
Demonstration Projects Act of 1977 (YEDPA) . The report contains 
findings of an analysis of nine YEDPA projects and the factors that 
contributed to effecti'Ve implementation, of these programs, srhe study 
compares discrete projects tritli<^dif£erent goals and objectives and 
identifies the ^successful implementation measures. The following, 
common featur^s^ of successfully implemented programs vere found: p]| 
programs vere* conceptualized and designed as nell as administered by 
local °pep3onnel; (2) all participating institution^ cooperated 
because each benefit^ from the program; (3) potential pitfalls are 
thought through in advance so that responses are available rapidly; 
(4) projects are buil^ on ideas that have already been tested locally 
and delivered by institutions of demonstrated effectiveness; (3) 
feedback and evaluation are built in from the beginning and results 
^*afe used; each project has a problem solver; (6) persbns with 
significant contacts in two or more institutional arenas required for 
program success are involved in key ways; (7) the pr<Jjects tend to 
consider all elements necessary to make the activity succeed r 
especially j^iyjhasizing job placement from lihe c^tset^ It was y 
recommended tliat thdse^'^^^uccess factor^ be taken into account when 
planning fo^ the implementation of other YEDPA projects. <Detailed 
case studies of the nine^ programs are included in the reports) 
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OVERVIEW 



R^^arch, evaluatton .and demonstration activity is usually directed to^ , 
problem identification and analysi^, determination of what works and for. 
whom, and testing of model program designs. Muph less attention' is paid , to 
' implementation 1ssues--the "how-to-do-it" .questions such as the ways 
designs- need to be adapted to local conditions, how key players can be, 
jnvplved and their interest maintained, how linkages 'can be achieved with * 
other institutions, how problems can be detected and corrected, how. 
Conflict can be resolved, how the learning curves and stabilization period 
* can be c'bmpressed. . ^ ^ 

These research^ and development priorities are the reverse of what^ 

— ^ratjatrly-nrralceFT-ttTF' , 
'greatest impact. Even the most innovative program approach can fownder, on 
.itnplemehtation issues. While the most pedestrian approach tnay have positive 
impacts if properly operated. Until basic activities are, operated 
effectively, it may be counterproductive to pClrsue more sophisticated ^ 
designs. As a generalization, the margin for improvement in employment and 
training activities, is overwhelming concentrated in ,the implementation 
#ena. With no change .in program designs--no "modelV programs or pew I 
approaches--the effectiveness of employment^ and training activities could 
be improved substantially with common sense in planning and management, and . 
more consideration of implementation issues. Modifications and program 
dasigft are not likely to be prdtiuctive unless the basic implementation 
tasks are already being handled effectively. , 

In the "knowledgement development" activities under the Youth 
Employment and Demonstration ^Projects Act, there has been a major emphasis 
on process ^evaluations linked, to impact evaluations in order to determine 
not o^ily what works (or does not) for whom, but also wl\y. Every major ^ 
demonstration includes at least one process evaluation and may also be 
covered by crosscuttfng studies of repl ication, proces?^s, program "batting 
.averages," learning curves and the like. The Standardized Assessment 
System for youth demonstrations programs includes a process questionnaire . 
which permits quantification of the key dimensions of Tocal program 
impVemention so that these can be analyzed along with quantitatively 
measured impacts. . * * . - ' , * - 

f 

This volume represents another dimension of this effort. One of the 
integral knowledge -development activities" has be^n the identification of 
"model"- programs and elements" that have emerged at the T-bcal level under 
the decentralized CETA system. These models include both well-run 
conver\tional activities and those tha^t have innovative ^fe^itures. Iden- ; 
tification of models includes an effort to identrfy implementation hints. 
Howeve.r, each project can only explain how jt^ achieved success, which may, 
, np^t;^be 'the key ingredients in other circumstances. The present analysis, 
in contrast, compares discrete projects with different goals and objectives 
and seeks to identify the success Ingredients. It finds - certain comrjion 
features: c " • I ^ ' 

' First, the projects involve all the key local "player/^ "from the 
outset. Those that conceptualize the projects ares:losely linked to or .are 
the same persons who subsequently adm^inister the projects^. 
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Second, there is a convergence of interest among the key instituti'onal 
players; all benefit from cooperation. 

Third, the potential pUftflls arg thought. through in advance so that 
responses are fortt)coming' rapidly. • • • 

' Fourth, th^ projects are built on ideas that have already been tried- 
locally ^nd are delivered by institutions of demonstrated effectiveness, 
suggesting the need for an evolutionary rather than revolutionary proqess 
0/ program change. 

Fifth, mechanisms for feedback and evaluation arfe built-in from the 
outset arid the results utilized. Each project, has . a "fixer" who con- 
centrates on problenK resolution. J- . 



Sixth, "double agents".— persons with s^i^nificant contracts in two or 
more institutional arenas required for program succiesS— involved in key 
ways. ■ " 

\, Seventh, the projects tend to cons ijder all elements necessar^f to make 
the activity succeed. In particular, placement iss given emphasis fronrthe 
outset rather than waiting untiV participants are far along in the 
programs . 

More detailed implementation findings will emerge from the research, 
evaluation and demonstration activities now underway, but this review, 
contains important information of use ^a't both the national and )ocal 
levels. ' .J 

This review was commissioned as part of the work of the _\(ice 
President's Task Force on Youth Employment'. Its findings- were factored^ 
into the I'egislative and administrative recommendations made by the Task 
Force- and subsequently proposed by the Carter Administration. 

. This study is ^ of "knowle'dge" development" activities mounted M'n 
conjunction with- Research, evaluation and development activities funded 
under the Youth Employment and Demonstration Projects Act of 1977. The 
knowledge devg;iopment effort w-ill result in literally thousands of^written 
products. Each activity has been structured from the outset so that it is 
self-standing but also interrelated with a hpstJOf other activities. The 
framework is presented in A Knowledge Development Plan fo> the Youth Em- 
p1 nvme nt and Demonstration Projects Act of 1^77. A Knowledge DeveTopment 
Plan for the Youth Initiatives Fiscal 1979 and Completing t he Youth Agenda; 
A Plan for Knowledge Development, Dissemfnation and Applicatio n for Fiscal 
1980. . . . ^ 

Information .is availa'ble or will* be coming available from these 
various krrowledge development efforts to help. resolve an almost limitless 
array of issues. However, policy and practical' application will usually 
require Tn'tegratidn and synthesis from a wide^range of products', which, in , 
turn, depend on ^kn owl edge and availability of these products. -A major 

V shortcoming of past research, evaluation and demonstration activities has 
been the failure to organize and. disseminate the products adequately to 

"assure the full exploitation of the findings. Tlie magnitude and structure 



of the youth knowledge development effort puts a premiyjn on structured 
analysis and wide dissemination. ^ 



' As part of its knowledge development mandate, therefore, the Office of 
Youth Programs of the Department of Labor will organize, publish and 
disseminate the written, products of all major research, eval uation *and 
demonstration activities , supported directly by^ or mounted in conjunction 
witih OYP knowledge development efforts. Some of the same products may also 
be published and disseminated through other channels, but, they will be 
-included in the structured serjes of Jouth KnowlQ()ge Dev>elopment Reports in 
order to fac^iTitate access and integration. 

The Youth l^nowl-edge Development Reports , of which this is one", are 
divided into twelve broad categories: 



1. Knowledge Development Framework ; The products' in this category 
c^re concerned with the structure of knowledge development activities,, the 
a^essment metho(^ologies which are employed, the meas|rement instruments 
anA their val idation, the translation of'knowledge into policy, and the 
strategy for dissemination of findings. 

2. Research on YoutfT Employment and Employabil i ty Development : The 
products tn this category represent analyses of existing data, presentation 
of findings from hew data sources, special studies of dimensions of youth 
labor market problems, and policy issue assessments. 

3. Program Evaluations ; The products in this category include 
impact, process and benefit-cost evaluations of youth programV^ncludi'ng 
the Summer Youth Employment Program, Job Corps, the Younjg j^uVb Con- 
servation Corps, Youth Employment and Training Programs, Youth Community 
Conservation, and Imp^^ovement Projects, and the Targeted Jobs ' Tax' Credit. 

A*-* Service and Participant Mix* : The evaluations and d^onstratiqn's 
summarrzed. in this category concern the matching of different types of 
youth with differ&nt service combinations. This involves' experiments with 
work YS. work plus remediation vs. straight remediation as treatment 
options. It ^Iso includes attempts to mix disadvantaged and more affluent 
participants, as well as youth with older ^workers. 

5. Education and Training Approaches ; The priOduGts in this category 
presejrvt the findings of structured experiments to test th^ impJct an^ 
effectiveness of variotfe education afnd "^ocat:|onal training^ approaches 
intlud<ng specific education methodologies for the disadvantaged,, al- 
ternative education approaches and advanced career training.' ^ 

. "6. Pre-Employtirent and Transition Services : The products- >n. this 
category present the findings of structured experiments to test the impact 
and, ^effectiveness of school -to-work transition activities, vocational 
exploration, job-search assistance and other efforts to . better prepare 
youJ:h for labor market success. . 

7/ Youth Work Experience : The products in this category address the 
organization of work activities, their output, producti>% roles for youtn, 
and the. Impacts of various employment approaches. 



• * 8. ' Implementatiori -Issues; This category includes ' cross-cutting 
/ analyses of .the practical lessons concerning "how-to-do-it." IssuesPsuch 
as learning curves, 'replication processes and programmatic battina 
averages" will be addressed under this category, as well ^s the comparative 
•advantages of alternative delivery agents'. ' . - ^ 

9." Design and* Organizational Alternatives ; The -products in this 
category represent assessments of demo nstra't ions of alterpative program and 
delivery a»*rangements ' such as consolidation, year-r^d preparation for 
•summer programs, the 'use of incentives, and • mul ti-year tracking of 
- individuals. 

10*. Special Needs Grbups' ; The product? in this category- present 
findings on the special problems of and the programmatic, adap-tati'ons needed 
for significant' segments including minorities, young mothers, troubled 
youth, Indochinese' refugees, and the handicapped. ■ 

11. Innova-tive Approaches ; - The products in th;is category present the^ 
findings of those* activities* designed to explore new approaches.. The 
suWects covered include the'.Youth Incentive Entitlement Pilot Projects, 
private sector initiative's, the national youth service experiment, and 
\ energy initiatives in weatherization,' low-head hydroelectric dam resto- 
ration, wihdpower; and' the likef^ ' * , 

12 Institutional Linkages ; The products in this category include 
studies of institutional arrangements and linkages as we>i*as assessments 
of demonstration activities to encourage such ■ linkages with education, 
volunteer groups, drug abuse, and other youth s^erving agencies. ^ ' ■ 

In each of these, knowledge ■ development categories, there will be a 
rang'e of discrete demonstration, research and evaluation fictiv-gies focused 
on different policy, program and analytical issues; In turn, 'each discrete 
knowledge development project may 'have ^ series of written products 
addressed to different dimensions of the \ issue.- For ^stance^ a,ll 
experimental demonstration projects have' both process and impact eval- 
uations, freauen^ undertaken by different evaluation agents, fjindings 
will be published as they become available so that there will usualily be a 
series of reports as evidence accumulates. • To .organize these products, 
^ each publication is classified in one of the twelve broad knowledge 
development categbries, described in terms, of the more specific issue, 
activity or cluster of activities to which it is ^ddressed/ with an 
identifier of the product and what it represents 'relative to other products 
in the demonstrations. Hehee, the multiple products under a knowledge 
development actwtty -are closely interrelated and the activites in each 
broad cluster have significant interconnections. 

0 

This volume should be aa^essed in conjunction with Program Models 
and Innovations and Imprdvinq^he'Design and Operation of the Summer Pro- 
gram, Volume^ , which both identify model prograjjis and elements. 

) . Robert Taggart 

» ^ Administrator 
• — ■ ' Office of Yputh programs 



1 



iv 



TABLE OF CONTENTS 



VOLUME I 



tAGE 



V 



OVERVIEW 
SECTION I - 



PXECUTIVE SUMMARY 



I. 

II. 
III. 
IV. 

V. 
VI. 
. VII. 
VIII. 



Nine YEDJ^A Programs . ^ . " 

The Implementatiorj Of These^Siine Programs , 
What Y'EDPA^Tis, What Its Goals Are/ And What It Has Done So Par 
Some Background On Policy Implementation 



The' Effectiveness Of ' The Implementation Of These Nine Programs 

The Development Of A Social Policy Infrastructure. At The Loc^l Level 



YEDPA's Effective Implementationr In A Variety Of Settings 
What This = Report* Does And Does Not Do • ' u 

r ■ 



i 

vii" ' 
•1 . 

i 

2 

' .8 
35 • ^ 



.'SECTION II --.ANALYSIS AND RECOMMENDATION 



I. 
II. 

III. 
XV. 

V. 
VI. 
VII. 

VIII. 
IX. 

XI. 
XII. 
^XIII. 
- XIV. 

XV. 



* Focusing On The Implementation Stage v. , ' ' 

J- Implementation:^ Complex Program Assembly And A** Process Of Avoiding 
' 'pitfalls ' , • • . " W / 



'Program Assembly 



Successful Program Assembly: A Strong Executive, The Creation Of 
Interest Convergeoce^ Aeci Securing It Down To The Worksite 

Implementation: A Process Of Avoidindf Pitfalls ' . • • * ' 

The "Benefits Of Previous Direct Oper^in^ Experience " ^ 

Building And Modeling New YEfcPA Programs On Previously Successful 
Programs . . < 

Scenario Writing: Another Aid Ir? Anticipating Implemqtitation Pitfalls^ 

Institutionalizing Evaluation |did Reassessment* Mechanisms ' ^ . , 

Th^ Need For gtrong Program Ex,ecuti^ves And The Pursuit Of "Fixer** 
Strategies v ' - " 

A Program Executive's Contributions As A "Double Agent" 

Program^ Executives' Ties To Sources 6f Jobs. * 

Executive Talent Is MQ(|:e Scarce ^Kkn Money (Jr Good Ideas ^. ^* 

The Need For Modest JVnd S-^ple Program Design * * >' 

Maintai^vo^^^JThe Diversity of YEDPA's Overall De^gn* As A National 
Program ^ ' / • » 



XVI. Some Final* Thoughts * 



68 

7,1 

' 71. 

. 73 
79 
I 79' 

82 
83 
86 

88 
91 
93 

94 ; 

95 

97 
99 



ERIC 



•v. 

EXECUTIVE SUMflARY ' 



This summary contains twc^ sections- The "intrbduption" presents our 
most general findings and explains vha\; the report does ancj'^does not do. 
/The second section , "analysis Bnd recommendations," combines these two: 
the recomm^dations are^^clfosely Based on our analys^is of nine- YEDPA pro- . 
grams. Thus these recfbmanendatioos should indicate to the readej^ the actual 
conditions that we found contributing to effective implementation in the 
nine. For 'this summary, the second -section merely 'asserts the conclusions 
of our analysis. The detailed evidence and,"illustration behind them are 
presented in the body of the Final Report, with the complete case studies 
of the nine in Volume I iT Appendix B. 
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INTRODUCTION 



(I) NINE YEDPA PROGRAMS ' . * ' 

Our report focuses exclusively on nine YEDPA programs* selected on ^ 
the basis of preliminary evidence (collected by us and previous investi- 
gators who had analyzed scores of YEDPA programs) which indicated that 
these nine had been effectively implemented, ^ ^ . , 



^ Our analysis first ad<iressed the question of whether in fact these 
♦'nine programs were implemented effectively. Then, to the extent that 
they were implemented effectively, we attempted to ejcplain why they were. 
Finally, we attempted to analyze the policy implications of our descrip-- 
ti6ns and explanations in order to f^^me recommendations, * ' ^ 



Our analysis was greatly assisted by the cooperation of the staffs 
of these nine programs and many DOL administrators, especially Robert 
Taggart, Joseph Seiler, Janfet Rosenberg, aod Frank Slobig. ^ 




ill) THE IMPLEMENTATION OF THESE NINE PROGRAMS • ' 

Implementation generally was effective in the nine programs analyzed . 
These programs generally satisfied to a significant degree our broad cri- 
teria for effective implementation: 

The program was able to' hold delay to a reasonaible level. 



* ' Albuquerque's WORP, AlbuqvierqueVs THE, Baltimore's YouthWorks, 
New Haven's Ventures in Community Improvement Program,^ Newark's Independence 
High School, Pittsburgh's STAY, Portland's Emergency Home Repair Program, 
San Antonio's YCCIP, Syracuse's BOCES-Hancock Training Program. 



• TWe program was able to hold financial costs to a reasonable 



level. 



The program was able to meet its original objectives without 
significant alteration or underachievemeYit of these objectives. 
(Here we reean the specific -objectives of DOL and local program 
executives rattier than merely the general objectives of the 
original legislative mandate.) - ^ *>. 



(ill) WHAT YEDPA IS, -WHAT ITS GOALS ARE, AND WHA'5 IT HAS DONE SO iFAR 

(A) The Youth Employment and Demonstration Projects Act of I??? rep- 
resented a major new fedej^al initiative aimed^ at understanding ,and\ al- 
leviating the projsiems of unemployed youth . ' Y^:DPA created four new^pro- 
grams (each^with a different target and different strategies),, and de- ^ 
veloped a complex process of "knowledge development" (which mounted a 
variety of studies, demonstration projects, and experiments). The size 
and scope of the Act are significant: nearly $1.7 billion through, the 

'end of this fiscal year and 460 CETA Prime Sponsors serving nearly 
230,000 youth slots in YEDPA programs. Nevertheless, YEDPA should be 

Viewed as .a beginning: .an important first step in addressing in a com- 
prehensive," diverse, innovative, and of.teh ekperimental fashion,, wftat 
has been described as a national crisis-staggering levels of youth un- 
employment, primarily concentrated in' poor urban and rural a/reas. 



During the process of selecting the nine upon whidh we would focus, 
we connected preliminary evidence on scores of other YEDPA p'rograms. 
Our .preliminary -impression is that in addition to the'nine^ we selected, 
many of these other YEDPA programs' were implemented rather effectively . 
Moreover, fo» the nine we analyzed, during the first eighteeen months .1, 
of YEDPA' s existence, implementation seems to have 'occurred more rapidly 
than usua-lly is the case for most social programs. 



(B) YEDPA is coitiprised of four programs: 

Youth Conservdtion and Cominunity I;nprpveinent Projects (YCCIP ) . YCCIP * s 
purpose As "to provide youth experiencing severe difficulties obtaining em- 
ployment with .we}.l-supervised work in project^ that prc^duce tangible bene- 
fits to' the community" (usually involving worlc- which^ woJ^J-d otlierwise not be 
carried out; including a range of. community improvements such as, public 
housing rehabilitation and repairs to the homes of the Ipw income persons. 
$115 million was allocated to YgQIP, which has serve'd nearly -5^7000 youth- 
in YEDPA *s first fiscal, year. v ^ ^ ' , • ' 

youth Incentive Entitlement Pilot 'Projects (YIEPP ) ; YIEPP is the-most 

. / ' ' ' 

%experiin!S;ntal * of the YEDPA programs, tts .explicit purpose is to demonstrate 

"the .efficacy 'of guaranteeing otherwise ^onavailable employment" to dtsad- ' 

vantaged youth who "i?esume or maintain attendance in secondary sc^pol" or in ^ 

an equivalency program. YIEPP*s fundamental goal is to test the ect or f 

^ ^ #^ 

assured work on school attendance , $115 million was reserved for the En- 

fi 

titlements and throbgh March 1979, over 50,000 youth had been served in the 
17 Entitlement projects. Over 80% were from minority groups. The minority 
percentage is the highest ^ for any of YEDPA *s parts. . 

' Youth Employment and Training Programs "(YETP ) : YETP is the lynchpin " 
of YED^ with programs' ranging f rom^ "community betterment activities" simi'- 
lar to YCfclP to a host of "training and 'services^* generally similar to 
those already allowed under CBTA Title II B. \. » * ^ *' 

Several features distinguish YETP from the other parts of YEDPA and 
from previous CETA youth prc^rams, although most of them are matters of de- 
gree and emphasis: broader "eligibility; an elaix^rate planning process; the 
involvement of public schools; coordination with other parts of CETAj and 
allow^ances for experimentation.^ ' / . 



Twenty-two percent o^. the money* allocated to each prime sponsor was to 
be '*used for program^Tfor in-school youth carried out pursuant to agreement^ 
between prime sponsors and local educational agencies". This 22% set-aside 
is probably the most well known provision of YEDPA. 
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The original appropriation for" YETP was $537 million, with 185,600 
■participants e.nrolled in YETP through Mdrch 1979, (over 'three times'' the num- ^ 
enrolled -in Y^PA's other three programs combined). • ' * 



Young Adul^ Conservation Corps' (YACC ) : The Young Adult Conservation 
Corps was created through a" new Title added to CETA to offer employment to 
"youths who would otherwise not be currently productively employed" through 
"useful conservation work" on "publi? land^ and waters". I-t is administered 
through an Interagency agreement with" the Departments o'f Interior and Agri- 
culture who virtually manage all of YACq. Except for the modest .referral 
role of the Employment Service and some pro forma coordination requirements, 
YACC is divorced entirely from the CETA system. This is a major reason that' 
this study did not include any YACC programs. We also focused exclusively 
, on the other three types of ^^gr^ because bhey will be considered for re- 
funding 1980* while YACC.'WiltT^st come up for refunding until 1982'. 

(C) In general terms, the Accomplishments of YEDPS are quite significant. 

• Nearly 750,000 youths have participated in YEDPA programs during 
the first two yea^s of implementation." - ^ 

• Y^DPA's major ptograms have been impleifiented by. the nation's CETA 
prime sponsor system. ^ 

• » 

• ' Innovative' experiments have been put in place both on the national 

and local level. 

J Research commissioned througl^ YEDPA has greatly expanded knowledge, 
€bout the extent and causes of ifo^th -Unemployment. 

• For the first time, '^he youth emploi^nt system has, been brought 
). *into substantial contact with public secondary education. 

• Youth unemployment rates have come down, with YEDPA. accounting for 
most of the new jobs gained by minority youths in the past year. 

^ % . . '■ • , 

• The majority of' youths served by YEDPA are from minority groups. 
In the twenty years prior to YEDPAi, employment/population ratios 
for black youth fell almost in half and unemployment rates nearly 
tripled, .some improvement in black youth labor force participation 

, has occurred in the 1977-79 period, although official jobless rates 
^partially mask the progress by not revealing the extent of rtew 
young entrants. Cfver the past tv«5 years, for example, unemployment 

xii- V. 



rates for white youth age 16-21 deqreased 3.1 percentage points 
while it decreased 4.8 points for minority youth and there was a 
20% increase i,n the employment of black teenagers ages 16 to 19. 
It i§ estimated ^that at least half this ' increase stems f rom YEDPA 
and the other federal y<puth initiatives. 

• , ^ ^ ' r • 

0 Ni^mbers alone, do not revea^l^he remarkable range local programs. 

• The employment and^raining system has been capable of adapting^ to; 
new requirements, ok cutting through normally expected delays an^ 

, of providing youth job opportunities on a large scale Snd rather 
quickly * 

• Prime Sponsors have targeted their programs cm the economically 
disadvantaged'' to a degree greater than required by YEDPA . 

• "Work performed under YEDPA has been shown to have both tangible com- 
munity benefits and genuine economic value .<^^' 

• There is a growing consensus, on all levels, that private^ for-profit 
employers must be more deeply involved in solving, the nation's youth 
employnient problems . YEDPA has acHieved more private sector irivolve- 
ment than any previous federal effort. 



The 22 pelrcent set-aside tends to work well as 4 financial incentive 
for Local Education Ageaicies to participate in joint action with 
the prime sponger . ' ' - f 

Prime sponsors are^ capable of managing youth programs, even those 
with the scale and complexity of the Etybitlement , although their 
capability varies greatly. ^ 

^ ■ • • ' *. 

The knowledgey development strategy has been particularly effective 
in devising innovative delivery approaches (such as intermediary 
corp^ations) structuring demonstration projects, coordinating 
basic research, and increasing awareness of the value of experimen- 
tation. ^ i 

YEDPA has led to ihcreased connections between prime sponsors 'arid 
a multiplicity of community based '^and non-profit organizations . 
The record is less auspicious with unions and private employers. 



<IV) THE EFFECTIVENESS OF THE IMPLEMENTATION OF THESE NINE PROGRAMS - 

• . ■ ' • . ■ . 

The complete details of the degree to which these nine programs satisfied 
' our three criteria" fojf effective implemericktion are in Appendix B. There are 
sunsnaries in the introduction, presented roughly in the order of each program's 



xiii 



ERIC 



1 «^ 



effectiveness of .implementation (ranked by' quartiles) . There are n6 exact / 
rankings because the nature of the data does not. lend itself to such pre- 



cision: - , % 



Very Effective Implementation: Pittsburgh's STAY, New Haven's. VICI 

• Highly Effective Implementation,: Portland' s EHRi "Syracuse' s BOCES- 

' ■ Hancock, Albuquerque's THE program 

Medium Effective Implementation: ^^^buquerque' s WORP program, Newark's 

IHS 

Bordeiirine Effective Implementation>J Baltimore's YouthWorks, San . 
• Antonio's YCCIP . 

, ^ 'u. ^ . • 

Even these quartile* rankings, a^ not exact, and there is an overlap between, 
•most ptbgrams :.n contiguous^ categories. But t4eir major purpose is to in- 
dicate that though all riine were effectively implemented, there is signifi- ■ 
cant variation in the degree of effectij^e implementation of each. This 
variation is significant because it seems to ^e' associated with the^reserice 
or absence of some of the conditions that we 'found to" contribute to effective 

- ' \ \ ' 

implementation of YEDPA. ■ , \ - . 



(V) 



THE DEVELOPMENT* OF A SOCIAL POLICY INFRAS-l-RUCTURE AT THE LOCAL I^VEL 



We found that the conditions in 1979 surrounding the' implementation of 
|yeDPA -(and similar domestic programs) seem to be significantly more favorable 
'for effective implementation than they were fifteen or even ten years ago, 
.especially local conditions. Thus many\of our Tecomendations are more feasible 
today than in the past. They are based on programs that are more replicable 
than in the past because these favorable cohdij^ons are more widespread now. 

(A) AS Sar Levitan has argued, actors and designers at both the federal and 
local level -leargied a lot about -designing and implementing social J-olicy 
during the 1960 's and 70' s. 

, H owever, in addition to this learning, in the tiast fifteen Y^ars a ^ 
rich and deve loped social policy infras tructure has grown up at the 



local level. 
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The individj^al-s and organizations which comprise this infrastructure are 
oriented toward innovation and social progress. Many are alumni of Great 
Society programs^ others a;:e alumpi of the post-Great Society innovative 



programs df DOL and.^HUD. 



The individuals rfepreserib'-^a new class of activict bureaucrats. Or- 
ganizers 4-s a good functional description; likening them to community or 
labor organizers captures a good deal of t^eir b*ackgrbund and personal' 

predilection. However^ they play a larger role and their "positioning" 

* ' • I */ ^ 

IS broader (e.g. , they are bureaucrats). 
y * • 

We also found rich organizational development. . These organizatiqfis 
are "established". These persons have helped to develop numerous community'' 
ba^edi^rganizations (CBO's) as well as new, public agencies (or special pro 
grains within tliem) . These organizations are experien;2red, effectively and 
relatively prosperous-. ' - ' • ' . * 



(B) All this has produced complex organizaticmal and personal networks that 
link persbns and organizations and give them overlapping interests.^ The net- 
works have grown over time ^nd are built on pa*st relationships and tru^t . 
All of this greatly facilitates securing joint action and progrfen assembly . 
They smoot^i the 'way for effective implementation . ^ 

/ 

(C) For YEDPA* a good deal of this learning, experience, infrastructure and 
a good many outstanditig alumni have developed directly and indirectly from 

CETA and earlier manpower programs. YEDPA has benefited greatly from CETA's 

" . . ... . \ 

positive and negative lessons . ^ 

(D) These organizations and indivic^als have not^u^ed these e:xperiences, 
knowledge, and networks to become conservative: They have used it 'to become 
more irinovative. They are established, but they are not^establishment". 
They continue to seek new programs, new solutions and are open to experiment 
and change. . ^ 
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(E) The development of this local inf rastruqture and local networks that 
ismooth the way for effective implementation represents a major change fromp 
the pattern described in the implementation literature on programs of the 
1960's and early 1970' s. A common theme in thSse studies was the impleihen- 
tation difficulties caused by local actors. At worst, local actors were 
found to resist innovative federal designs ^nd programs. At best, even^ 
when they sought to aid implementation, local actors were found to be lack-* 
ing in sufficient resources and/dr abilities to make itvork,^ 

\ By con4:rast, our findings of these local infrastructures and net- 
works means that local condi-blons and actors now tend to provide 
an extra' boost to €he implementation of federal designs and pro- 
grams ratjier t^an an' obstacle. . 

^ ■) 

(VI) YEDPA'S EFFECTIVE IMPLEMENTATION IN A VARIETY OF SETT.INGS 

« 

We found th^ within the pattern of effective implementation of these ^ 
nine programs there is a good deal of programmatic, geographical, and socio- 
economic vVriation . It occurred in different types' of YEDPA programs (the 
' nine i-^clude two YIEPP programs-^-a .Tier 1 and a Tier 2~two YCCIP programs, 
ana five YETP programs) and in diS^erent types of cities (varying by size, 

region, economic bases', and ethnic and income mixes) • Of course, all of 

f 

this is no accident; our program selection sought to produce these varia - 
tions . 

The nature of our data and anaiysis-are such that no systematic con- 
clusions can be drawn from this variation • However, effective implemen- 
tation of YEDPA in such a variety, of settings is significant because it 

gives a rough indication that the possibi'litieS of effectiveness are not 

limited to any one type of program or cityT 



(VII) - WHAT THIS REPORT DOES AND DOES NOT DO 

We 'can tell the Task Force^anuch about— * 

* ' • How to improvfe the implementation of these programs 

• How j(void implementation failures. . ^ 

We cannot tell the TasH Force with full confidence how to produce ultimately 
etfec,tive outcqLes fr^ti^ youth employment programs . [ 

\ 'i . . ' • 

We analyzed the effectiveness of the implementation of these nine pro- 
grams, but , not their ultimate outcomes. Of course, our ultimate goal is a 
policy that has effective outcomes (one whose effect on the target popula- 
tion is ^sitive; one that tends to ameliorate that social problem in re- 
sponse to v^ich it was created, or. at least creates some positive 'change in 
it) . In addition to being etdopted effectively and then implemented effec - 
tively, it must be first a good policy, with a design appropriate to the 
problem . "A fast train is worse than a slow one if it takes you in. the 
wrong direction." Thus effective implementation is necessary to achieve an 
effective outcome but not sufficient in. itself . 

4 

Why then does this study focus almost exclusively on tHe element of-im- 
plementatior^? First, to aralyze conditions and factors associated with ef- 
fective outcomes, we must be cible to measure the outcomes (e.g., the effects 
of the progran) on its participants) . However, these nine YEDPA programs are 
so relatively new that ther.e as yet has noJt: been enough time for the prdgremT 
to *have measurable effects on a I'SiJse number of participant's • (All had been 
in their YEDPA operation for less than eighteen months at the time of this 
study, June 1979. But on the whole, these nine VEDPA programs have be*en imr 
plemented mor^J^pialy than ysually is the casp for most social programs.) 
Thus, placement ^data (one indi%,ator of outcomes) are scarce *a^ yet. Moreover 
pimple place5}ent data do not yield in themselves defihitive conclusions abo^t 
outcomes because t hey are, Shaped or "contaminated" by factprs other than" pro- 
grams* effectiveness (e.g., the tightness of the ideal labor market And other 
environmental factors) . ' , * 
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In focusing almost exclusively on implementation, we are able to say 
less than we would like to. But we' are interested in action rather than 
pure social science and thus reject the alternative of saying more, but 
have to wait to do so until the outcomes are fully discernible and 
measurable. 



#• Second, of the three major elements required for an effective out- 0 
come— an effective design, effective adoption, and effective im- 
plementation-»-presently ^he most difficult one to achieve is ef- 
fective implementation. 

It is the element on which domestic social policies most frequently founder. 
Indeed-, in the pdst decade or so, problems at the implementation stage have 
been the largest source of social policy failures ^d this is predictable. 
When the dfhplCTi§ntation of programs depends on many actors, as it must in 
•our heterogeneous.* society and pluralistic political system, there are nu- 
merous possibilities for -disagreement and delay. ^ . 

Tables 1-15 indicate '-hpw the multiplicity oi participants and per- 
spectives "dn a' YEDPA program combine to produce a formidable obstacle 
course of policy implementation (summarized on Table A of the executive 
summary, p. xii). However,* these obstacles to effective implementation are 
generic to social policymaking in the U.S. rather than limited to youth em- 
ploymenj: programs, ^his is the lesson of the broad range of case studies 
which we review from outside this area. 

\ ' • ■ . ■ - ' 
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TABLE A 



POINTS OF DECISION AND CLEARANCE NECESSARY FOR COMPLETION OF E^CH OF THE 
NINE YEDPA PROGRAMS: THE -MULTIPLICITY pF PARK CI PANTS PERSPECTIVES, AND 
AGREEMENTS'' THAT SHAPED THE COURSE OF EACH PROGRAM. - 



PR0GR7\M 

Pittsburgh's STAY 
New Haven's VICI • 
Portland's EHR 
Syracuse's BOCES-HANCOCK 
AiWKfuerque's THE, 
^Albuquerque's WORP 
Newark's IHS ' 
Baltiingre' s YouthWorks 

■J 

Sap AfJtonio's YCCIP 
t 




Decision 
P oints 

10 
. 19 
15 

-13 , ' 
11 

12 

' .15 

9 ' 



Cumulative Total 
Parti c ipants of. A g reements 



39 




50 


22 




72 


13 




31 


12 


ft 


46 


98 




119 


6 






20 




33 


408 




- 446 
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ANALYSIS AND RECOMMENDATIONS 



The recommendation^ in this report are empirically grounded* They do 
not represent our wishful thinking. Rather they are specifically based on 
our analysis of these nine.}YEDPA programs and secondary analysis of earlier 
studies for OYP. ? * . ' " ' c 
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Since they are empirically based ^ these recommendations also should in- 
\ - V , 

dicate to the reader t;he actual conditions that we found contributing to ef- 

fective implementation, in these nine . They are, however, written in the 
format of recommendations rather than as descript;ions to make them more use- 
ful toA^the ^llowing audiences who want answers to the qCtestion: "O.K. , 
this is how those programs worked and why, but what, do we do" on Monday?" 

• Program ^petators ^ . * 

• Analysts in VPTFYE, DOL, and Congress who are drafting, legislation 

• OYP and ETA policymakers who are making ♦allocational decisions 

For tfiis s\3ifanary, we merely assert the_^<fonclusions o^ our analysis. 
Th^detadled evidence and illustration bejAnd them are presented in the 
.body of the report, witji the complete c^e studies of the nine in Appendix B. 
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XD FOOJSING ON THeViMPLEMENTATION STAGE 



For. the following reasons we recommend that YEDPA policymakers ^t 



top, program operators, and everyone in-between focus ^a cjiisP^oPQ^tionate 
amount of their attehtion and resources on the implementation stage of these 
programs. (For some, such H OYP under Robert T^iofgart,' this will represent 
a continuation of their already significant effort at process evaluation.)^ 
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(A) Of the three major elements, required for an effective outcome— an ef- 
fective design, effective adoption, and effective i^pl^entation — presently 
the nvost difficult to achieve is effective implementation . It is the element 

^ on ,vyhich domestic social policieSyppst frequently founder , x/ ^ ^ 

currently there are many good general' ideas, for ameliorating social 
problems and many ^ good specific policy designs. But the legislative sue- 
^ cesses (the adoption st^ge) .pf yesterday have often become the impl^mtenta- 

^ tion probiSns-^rf^oday . Since the mid- 1960 's it h^s become much easier for 

.good policy ideas to traverse the adoption stage without major alterations. 
But then they were implemented ineffectively and did not create effective 
oy^oomes for citizens. Their implementation was^ either (a) inordinately de- 
l^^edV ol: .(b) it required expenditures far beyond what objectively wa% 
necessary, ^or (c) there was an alteration and/or^ underachievement of the 
policy's objectivefe, or some combination of all three. 

(B) We also ^recjimmend giving mor"^ attention to the implementation stage in 
order to selisitize policymakers to the essential role of implementation in 
creating effective outcomes. There is ample evidence that most of the in- 

. creased lip service pafS to impO-CTientation in the last^few y^ars is just 
that. The belief -that implementation issues are " relatively irt<643pif icant 
remains firmly grounded in many otherwise astute poKLQjgna^s and policy 
analysts ^or several understandable re^gons. ^ 

/ - , • • • ^ . ' 

i * 

9 

(II) IMPLEMENTATION: COMPLEX PROGRAM ASSEMBLY AND A PROCESS OF AVOIDING 
PITFALLS 

6 More sp^fically,we recommend that these actors become sensitized to 

the true nature of in)plementation: * . 

0 F^rst, effective implementation does not occur automatically . 
Rather it is a complex process of program assemb ly. It re- 
quires joint action to achieve the full assemblage . 
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• Second, roajor dif ficiilties wills^lmoi^t always characterize the 
, process of policy 'implementatiorif especially if the policies are 
even mildly innovative.. Implementation is a process -of avoiding 
pitfalls. ' ' ^ 



(III) PROGRAM ASSEMBLY ^ * 

Program assembly should be. viewed as involving the following general 
elements: 



Numerous actors (organizations and individual) are involved in the 
progranf assembly process ' (e.g., for a YEDPA program; The local 
^program itself and its staf f> the prime feponsor^ the larger politi- 
^ cal .entity and its leaders — the Mayor, the schools, thfe unions, 
/ public sector worksites, private sector worksites, CBO's, and post- 
program employers; often DOL and Regional DOL are also relevant ^ 
actors as well as intermediate bodies like YouthWork, CPPV, MDRC or' 
HUD). - ' s * -A 

^ I 

• These ^ctors have significant interests which are largely indepen- 
dent of each other and independent of th^ YKDPA program and/or t)f 
the prime sponsor and its larg^ politi<5al entity, 

(IV) SUCCESSES PROGRAM ASSEMBLY: A STRONG EXECUTIVE, THE CREATION OF 
INTEREST CONVERGENCE, ANDr^ECURING IT DOWN TO THE WORKSITE 



Successful program assembly should iRvolve the following eli^ents : 4 

• The program assembly process should be guided by a strong, effec- 
tive executive.^^ It wij-l not run itself.' It h^s to be put together 
piece by piece. Actors and interests have to be cajoled, convinced, 
and persuaded into joint action. Adjustments and adaptations have 
to be made. Coalitions have to be built . 

• Perhaps the most essential action or strategy for effective program 
assembly is the creation:^ of a pattern -of interest convergence in 
the relevant actoys and interests through the development of^com * 
plementary incentives > 
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} The executive should distribute incentives that will lead actors to find % 
their interest and the interest of x the YEbPA prqcirain in .convergence: ^ -situ- " 
ations in which while achieving' hil ovm obj ectives, bne actor also contri- 
butes to achieving the objectives ok another actor (e.g., we found that the 
■ work-providing agencies could, not receive the free labor they sought to in^ 
crease their productivity without simultaneously providing- the YCCIP pro- 
grams with the worksites which they sought) . . 

• « - Program assembly in a YEpPA program mus t be secured all the way 

down to isjie worksite- and' through to the process of job placement. 
' worksite management is difficult; it will not occur autom-aticklly. 

securing cooperation from bureaucrrti(^ctors and achieving ^th<i appropriate ^ 
recruitments, (participants that fit income and minotity 'targets; meaningful 
worksit^; good supervisors) are necessary bu^t not sufficient steps. The . 
program executive next must be certain that something is going on at the 
worksiteg' : the^ difficult task of teaching skill functions must be achieved. ♦ 
-The least automatic' part of assembling a. YEDPA program is the development of 
satisfactory job placement, and it requires constant efforts by the program 
executive. t * * . 
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•(V) IMPLEMENTATION: A PROCESS 0^" AVOIDING PITFALLS 

We -now return to the details of the second ma jor ' element of implemen- 
tation. . ' 

- ' • We recommend that YEDP^ policymakers come lio assume that major dif- 
ficulties will almost always characterize, implementation and that it 
. is a p rocess of avoiding pitfalls. They cannot assum e that someon^ 
else Uill cons ider tfie is>sue of implement ation feasibility and tha.t 
^^ne else will worry about the specific steps of program assembly. 

. • The' major strategy for avoiding implementation" pitfalls should be^" 

steps to anticipate them, so as to develop^ ways of avoiding them, ^ 
■ coping with them, and/or overcoming theih." 

— - ^ 

^The next eleven sections suggest some anticipatory tactics. They are dfe- 

scribed roughly in ascending order of importance. , > 
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(VI). THE BENEFITS OF PREVIOUS DIRECT OPERATING EXPERIENCE 

YEDPA designers and 'implementors will be better able to anticipati^ -im- 
plementation pitfalls if they previously habere nad direct operating ^experi -^ 
another YEDPA or manpower or education program. (A corollary: /we 
found that 'the 5epar^tion U^tween planning apd implementation/ which Jias 
plagued many earlier federal programs, can be bridged if 'the program planner 
th^n becomes the program operator.) * . 



(V^I) BUILDING AND 'MODELING NEW YEDPA PROGRAMS ON PREVIOUSLY SUCCESSFUL 

PROGRAMS * ' ' ^ 

"0 * ^ * ' • 

^he supply of persons with operating experience obvioysly is limited, 
even though recently it has been growing. Also, it is usually more reli- 
able to base policy strategies on institutional , ^ impersonal factdf.s rather 
trhan on personal, individualistic ones. 

_ •< 

♦ f 

• We thus recommend an additional strategy: building ne^ YEDPA pro- 
grams on youth programs previ6usI^N^uccessful in that locality ot 
modeling YEDPA programs^ on ^her successful programs so as to avoid 
' continually. "reinventing the wheel "^ 

New programs^have mani^ advantages, but when a program is new, untried 
and innovative, it , is' nor possible ,^o ancicipdce aid or even most of the 
likely implementation di£f icultiesl Our findings indicate that building on 
a prior one or modeling it after one increases the ability to antici^te im- 
plementation pitfalls. , ' 



(VIII) SCENARIO WRITING: ANOTHER AID IN ANTICIPATING IMPLEMENTATION PITFALLS 

Since it is not always possible or desirable to build or. model upon a 
prior program, we recommend the writing of a scenario as an additional aid 
in anticipating implementation difficulties . * ' * Ss, • * 
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Scpnario writing involves the imaginative construction of future se- 
quences of actions, the resul'ting conditions and reactions, aftd in turn . 
the further conditions and reactions that are developed, by all actors and 

. . ^' ■ - 

organizations. 

■ • Scenario writing sensitizes program executives to obstacles ahead 
and hPl n.c, develop a "dirty mind" ; the tendency^ anticipate and 
predict implementation difficulties and be especially attuned to 
the interests involved and their likelihdod of delaying, even re- 
sisting the planned implementation route (a "dirty mind would 
have predicted 'the ineffective .implementation of the swme flu 
vacgination campaig^iK^ 

Scenario writing brings the likely flaws and p ro blems to the forefront 
and forces designers and program exebutiv es to try to take account of , them.. 

Onlike almost all of our other recommendations, scenario writijig is 
not priitiarily extrapolated from our 'findings. Oivly the New Haven program 
made approximate use of it. But our recoffimendation is also based on the 
findings in other areas, both positive and negative (e.g., the swin^ flu 
case) . ' ' 



(IX) INSTITUTIONALIZING EVALUATION AND REASSESSMENT MECHANISMS 

A "dirty mind" is aware that most implementation difficulties cannot 
be anticipated fully and that a program's implementation cannot even come 
clbse to being free of error. ThP test of a good program is not the ab- 
.ence of error- but the abili t y to detect its own errors and the-rTrorrect 
them . 

Thus we recommend that the processes .of anticipation P^^i^^ion 
error detection and correction be institutionalized be^snd scenario, 
writing bv building into YEDPA pro g rams mechan isms for 
Z:<Z,IaZ. and reassessm ent of '^implementation. In many ofthe 
nine progr;ms, the processes of evaluation and reassessment led to 
the detection and correction of serious implementation problems. 
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(X) THE NEED FOR STRONG ' PROGRAM EXECUTIVES AND THE PURSUIT OF "FIXER" 
STRATEGIES 

Detecting errors without being able to execute remedies is Useless 

and frustrating. Neither program assembly nor the subsequent v adaptation- 

compensation responses run by themselves. They should be guided by a 

strong executive who has enough power to operate , * 

r 

• We also recommend that program executiv es consciously adopt "fixer'** 
strategies , " : 

A "fixer" is a person who makes repairs and adjustments in the imple- 
mentation j^cess to make it work. The "fixer's" adaptations -and compen- 
sations are designed to protect^ correct, and sometimes expand his program , 
especially through coalition building and constant intervention in adminis - 
trative detail . There is always a need for compensating in the implementa- 
tion process for omissions made at the design and adoption stages, which 
are inadvertent (because then we can never anticipate fully all the later 
implementation difficulties) and intended (because it was^not politically 
or financially feasible to include them earlier).. Numerous instances of 
each of these elements of the "fixer" strategy were used in the nine cases. 



(XI) A PROGRAM EXECU.TIVE^S CONTRIBUTIONS AS A "DOUBLE AGENT" ^ 

We recommend that prime sponsors seek" program executives who can play 
the^ role of " double agent " . 

# Some program executives in the nine cases made major contributions 
^ to effective implementation by acting as a "double agent". This 

role consi^t^^^^ the ability to secure joipt action among various 
interests In the program assembly process by virtue^ Q£vthe* execy^ ^ 
tive's standing and membership in more than orfe of the relevant 
camps in^the implementatiop process. A double agent activates and 
operationalizes linkages between organizations, agencies and other 
persons. 

Ini particular, all these double agents had direct experience with or 
access to major providers of jobs (most of \^tch were either in the private 
sector or with a semi -public agency) . 
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In 1979 it does not seem gratuitous to advise prime sponsors to try to 
find "double agents." The soci.al policy infrastructure and overlapping or- 
ganizational and personal networks have developed locally so much in^e 
past decade that th^re seenjs to have been a significanl^ increase in the sup- 
ply of talented program executives in general 'and potential "double agents" 
in particular. 

Despite this recent increase, potential program executives continue to 
be relatively scarce because of our limited knowledge of hoW to increasfe ' 
their supply by exogenous means. The limits this" places on strategies built 
around executives will be discussed shortly. <^ 



(XII) . PROGRAM EXECUTIVES' TIES TO SOURCES OF JOBS 



Prime sponsors in particular ought to seek program executives who al- 

\ re ady have ties to sources of jobs . / , . ' 
= / \ 

' There are so many ways that money can be ^bsorbed in a manpower program 
before one gejts to job development that there ;Ls a tendency to forget that 
jobs are essential for its effective implemen^tion. Developing an effective 
' classroom component is not easy but it is much easier than getting food jobs 
for youths, ~ " 



' . These program executives' ties preferably should be to private sector 
jobs . * . ' ^ 

Private sector jobs are more likely to constrain youths in positive ways 
because someone there is more likely to care if the youth doesn't show up or 
does his .job poorly. As Arnold Packer, Assistant Secretary' of Labor, has said, 
"Public sector jobs developed for youth typically tend to be short on pro- 
viding enough of the discipline needed to hol,d down a private sector job." 
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There is a need to emphasize private sector jobs because they tend to 
be overlooked*. Manpower programs are public? sector organizations and are 
run primarily by persons who have spent most of their careers in the public 
sector (or academic world) . Thus it is un^aerstandable that program execu- 
tives 'and their superiors are oriented toward public sector job development. 



(XIII) EXECUTIVE TALENT IS MORE SCARCE THAN MONEY OR GOOD IDEAS 



Our advice about fixers and double agents, though sound, has limits. . 

# The fixer strategy is difficult to replicate. Talent is more scarce 
than either money or good ideas, especially at the executive level.' 
And we have very imperfect knowledge of how to develop such execu- 
tives. ^ 

c 

As Professor James Q. Wilson has argued: "The supply of able, experi- 
enced executives is not increasing nearly as fast as the number of problemsA 
being addressed by public policy. This deserves emphasis, for it is rareiy 
recognized as ^a constraint. Anyone who opposed ^ bold new pro«|ram pn the:: 
grounds that there was nobody arouni able to run it would be accused of 
being a petifpgger at best and a reactit>pary do-nothir!^' at worst." ^ 

(XIV) THE NEED FOR MODEST AND SIMPLE PROGRAM DESIGN . 



In light of the scarcity of such persons, we recommend that the design 
of YKDPA should not rely exclusively on their presence.^ Moreover, the near 
necessity of talented executives to achieve effective implementation, coupled 
with their scarcity, leads .us to recommend a commensurate modesty in YEDPA • 
program design and in our overall expectations for the programs' effective- 



ness. 



• YEDPA 'program designs should be| innovative but realistic in that they: 

(a) ant^cipa^e implementation difficulties; 

(b) are modest, straightiEorward, and even s-imple . 
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We have already discussed what we mean by this anticipation process. 
Program designs should be modest and simple in that they^maintai n YEDPA'^ ' 
focus on the goals of job experience, training, j ob development,. and place- 
ment . By keeping to these specific, purposes, YfiDPA's implementation, be- 
comes more manageable and more likely to avoid the implementation pitfalls 
which have beset other social programs since the mid-1960's. ' , 

Effective implementation i$ a function, to a significant degree, of 
good Local administration, but that is not sufficient in itself. Even if 
and when a local progr^^has a talented program executive, he and the en- 
tire implementation process may founder" on *a highly complex program design. 



(XVl MAINTAINING THE DIVERSITY OF YEDPA'S OVERALL -DESIGN AS A NATIONAL 
PROGRAM 

A strength of YEDPA's overall design 'as a national prog/am ^ems to be 
the diversity it entjompasses (e.g., the nine^ry/^t^-i^ich^d two from 
YIEPP, two from YCCIP, and five from YETPT^^i^ith a good deal of diversity 
among local program designs). Moreover, the flexible overall federal design 
has allowed this diversity to develop rather than njfendating it. 

. We recommend that DOL continue to allow and encojirage this di<^ersity 
, . through pontinuing its flexible approach. ) 

Y6ul:T™pl-oymen1r^.-s-not a-.3ingle problem^mlrh-^ single cause or-a single. 

manifestation. It is a constellation of interrelated problems With complex 
■sourqes, occurring alr.across a large and heterogeneous Aation. Thus, both 
to maximize effective 'outcomes and to maximize learning, it seems wi^e to 
simultaneously allow various policy approaches to it. • 

We do not recommend that diversity be required through the maintenance 
of three or four separate programs within YEDPA. -Rather, programmatic and 
local diversity should be allowed and encouraged in the specific design of 
^individual programs. 
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^ (I) NINE YEDPA PROGRAI^ ^ • 

^Oxxr report* focuses exclusively on nine YEDPA programs* selected on the 
basis of preliminary evidence (collected by us and previous investigators 
• who had analyzed scores -of YEDPA programs**tp>i)ich indicated that these nine 
had been effectively dmplemented. ' 

Our analysis first addressed the question of whether in fact these nine 
progr,ains were-implemented effectively. Then, to the extent that they weire 
implemented effectively, we^tr%»pted tp explain why they were. Finally, we 
attempted to analyze the policy implications of our descriptions and explana- 
tions in order .to frame recommendations. ' / 

Our Analysis was greatly assisted by the cooperation of the stajffs of 
these nine programs and many 'dol administrators, especially Robert Taggart, 
Joseph Seiler, Janet Rosenberg, and Frank Slobig. 



(II) THE IMPLEMEN*PATrON OF THESE NINE PROGRAMS ^ 



Implementation generally was effective in these nine programs. T^ese 
programs generally satisfied to a significant degree our broad criteria for 



effective implementation: * ' . ' 

• The program wa^ able to hold delay to a reasonable level* 

• The program was aible to hold financial costg to a reasonable level. 



♦Albuquerque's WORP, Albuquerque's THE, Baltimore's YouthWorks, New Havep'j 
Ventures' in Community Improvement Program, Newark 's .Independence High School, 
Pittsburgh's STAJf/ PortlaYid's Emergency Home Repair Program, San Antonio's 
YCCIP, Syracu^se^ BOCES-Hancock; Training Program. 

**ln "References" (p. 100), see Wurzburg (1978a), Wufzburg (i978b) , Dement 
(1978), Ball (1979^), Ball (1979b), Feldman and Ostrower (1979); 



#\The program was able to meet its^ original objectives Without 
Vsignif icWt alteration or underachievement' o'f^the^e objectives . 
(Here we Jueah the specific objectives of DOL and local program 
executives rather than merely the general objectives of the 
original legislative mandate. , ^ 



( 



t 



(III) WHAT YEDPA IS, WHAT ITS GOALS ARE, AND WHAT, IT ffilS DONE SO FAR* 

^. " ^ * \ - . . 

The youth Employment and Demopstratibn Pirr^ects Act of 1977 represented 
a* major new Federal initiative aimed at understanding and alleviating the 
problems of unemployed youth. YEDPA created four new programs,- eacK of 
which had different target groups and different strategies. It al>so dolibled. 
the size of the Job Corps and set in motion an"' elaborate an<J complex process 
of "knowledge development" through which a variety'. of studies, demonstration 
projects, and experiments have been mountlld in* the past two years. 

The sizeind scope of the Act are significant: nearly $1.7 billion 
through the end of this fiscal ^ear and 460 CETA Prime Sponsors serving 
nearly 230,000 yoi^h slots in YEDPA programs. Nevertheless, YEDPA should 
be viewed as a beginning: an important first step in addressing in a Com- 
prehensive, diverse, "innovative, and often experimental fashion what has 
been described as. a national crisis--staggering levels-^of y^uth uneifiploy- 
ment, .primarily concentrated in poor urban and rural areas. 



Ik 



During t^he process of selecting the nine programs upon whicl) we would 
focus, we collected preliminary evidence ^ scores of other YEDPrf programs. 
Out preliminary impression is that, in addition to the rfine we selected, 
many of these other YEDPA programs were implemented rather effectively. 



) 



*This section is primarily based on the excellent materia^ developed by 
Erik Butler and James Darr in >The Yo6th Employment De monstration Projects 
Act of* 1977; Preliminary Lessong 
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fibreover, i^e nine we analyzed, during the first eighteeri months of 
YEDPA's%xistence implementation seems to have occurred more rapidly than 
usually is the case for most social programs. - ^ 

/ * . ef . 

YEDPA is comprised of four programs: Youth Employment & Trainipby; Pro- 

grams (YBTPK YETP is the lynchpin of YED?A. Its goals are sweeping and am- 
bitious: programs "designed to make^ a signif icaht long-ter^ impact on the 
Structural unemployment problems of youth", Th^se prograwns can range from 
"community betterment activities" similar tp YCCIP to a host of, "training and 
services" generally similar to those already allowed under CETA Title II B. 

Several features distingy4.sh YETP from the other parts' of YEDPi^ and fi;om 
preyi^s CETA youth programs, though mdst are matters of degree and emphasis: 
'broad^ eligibility? an elaborate planning process; the involvement of' public 
schools; coordination with pther parts of CETA; alloWknceS^or Experimentation. 
EK'gible participants are so-called "in-school" youth who are unem^jJ^oyeS or un- 
dereinpl(^yed and v?hose family income does not exceed 85% of the lower living 
standard. 

The YETP^ planning process re.quired consultation with unions and community 
based organizations, ap inventory qf local needs and resources, special do- 
ord\J.nation with local education agencies (^EAs) and the establishment of Youth 
Councils Cwith youth members)^. Twent^^wo percent* of the money allocated -to 
each prime sponsor was. to be "used for programs for in-school ybuth carried ^ 

* out pursuant to agreements between ^prime sponsors and locai educational 
agencies . " This 22% set asi<fe is ^)rqbably the most well knowji provisipn of 
YEDPA and the one vrtiich has caused the greatest itnmediate change in the ffl.an- 

''ning activities of prime sponsors. ^ . ^ ' 



*In discussing the dollar " allocations for YEDPA, we ''have stayed witli thf 
original approprfations in order to provide a sense of theif relative 

'Share of the fuhds. Actual exx>enditures have Varied so much t^at.the 
subsequent funding years alter this balance considerably. . , 



^8 
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The original appropriation for YETP was $537 million, of which about ^ 
$450 million was available to prime sponsors and <;over^or^. v As of March 31, 
1979, there were 185,600 participants enrolled in Y13TP PKogi^ms, exclud^Jig 
those involved in the discretionary projects. This is over three times the * 
'number enrolled in YEDPA's other thr'e'e programs tYACC, YIEPF, and YCCIP)-^ • 
combined. ' Over 80% <^ YETP ^participants were economicalPy disadvantaged, and 
a]|^jt half were, women and half minorities. ^ ' . ^ 

Youth Conservation & Community Improvement Projects (YCCIP) ; YCCIP ' s 
purpose is; "to provide youth experiencing severe difficulties obtairTihg em- 
ployment with well -supervised work in projects that produce tangible benefits 

to' the community". ' * 

^ * 
Appropriate projects are defined by the Act as being -"wo^ which would 
otjierwise not be carried out" and can include a range of "community improve- 
ment" such ^s' rehabilitation of public housing, Repairs to the homers of low- 
income residents, energy conservation measures, and park maintenarlce . «• ^ 

The Act emphasizes the "quality of the sypervision pro vided to youths im 
YCCtP projects aaa the need to coCtfainate the youths' work ex perience with 
loeat. educatigf/agencies, including "the awarding of a cademic credit". — At the ^ 
same time, proposed projects >are to be ."labor intensive" and to provide "job 
training and skill development opportunities ". 

=YCCIP is the' only part of YEDPA with mandated limits /On ad ministralfive 
costs (10% of project funds) and participant wages (^t least 65% of total pro- 
ject costs ) . $115 million was allocated, for r^IP, equal to the amount for 
YIEt>P,^ ' ^ ' ' , ^"^^ 

^ -Nearly 32,000 youth were_ served by YCCIP in the. first YEDPA fiscal year 
(i978) and over 80« of these were economically disadvantaged, indicating that 
prime sponsors moi-e bhan.pet the Special emphasis_of the law. Over 50% of 
.'those served were minorities, but only a quarter of-the enroUees were women, 



^ You^h Incentive Entitlement: Pilot Projects (YIEPP) : YIEPP* is the most 
experimental of the YEDPA programs* Its explicit purpose is to demonstrate 
"the efficacy ojf guaranteeing otherwise unavailable employment " to disadvan- 
^ged yquth who " res\ime or maintain attendance in secondary school" or "iTn a 
program which lead§ to a certificate of high sqhool equivalency". To he eli^ 
gible^for an Entitlement project, a youth would have to be (a) economically 
disadvantaged! (b) betwjsen 16 and 19 years old; (c) reside in a specific geo- 
^apbic area; and (d) comply with the school attendance pr^ision. ^ 

> inEPP*s fundamental goal i^to teat the effect of assured work on school 
attendances Subsidiary goals included testing the capacity of prime sensors 
to^perate such large scale administrative and job creation progr^s for yoxath ^ 
\ . ^ experimenting with the use of direct wage subsidies in the private sector; and 
utilizing alternative schooling arrangements to entice out-of -school youth 
back into the educational system' . 

Several features of the Entitlement set it apart from the rest of YEDPA: 
the concept of entitlement; the allowance for private sector wages; the most 
^ restricted -"incpme "eligibility in all of YEDPA; and the most elab^^^Ee and 
rigorous evaluation desi^r^. • 

$115 million has been reserved for the Entitlements. Through March 1979, 
over 50,000 youth h^ been served in the Entitlement projects. All were eco- 
nomically disadvantaged/ just over half were women, and over 80% were from 
minority groups. The minority percentage is the highest for ^ any of YEDPA *s 
parts. 

Young Adult Conservation Corps (YACC) : The Young i^dult Conservation 
Corps was created through a new Title added to C§;PA. Its purpose was to offer 
employment to "youths who would otherwise not foe currently productively em- 
ployed" through "useful conservation work'^ on "public lands and waters ", 

e ; / 
i 

It is administered through an Interagency agreement with the Departments 

o*f Interior and Agriculture who virtually manage all of ^CC. Except for the 

^ 



\ 



modest role of the Employment Servig6 in referring applicants and fo/some 
pro forma coordination requirements, YACC is divorced entire ly from the 
' CETA system .^ This is a major reason that this study did not include ainy 
•YACC programs. We also focused exclusively on the other three types of 
programs because they will be considered for refunding in 1980 while YACC 
will not come up for refunding iintil 1982. ' 

if? ' 

In ^neral, the accomplishments o£ YEDPA are quite significant: 

• Nearly 750>000 youths have participated in YEDPA programs during 
the two years of its implementation. 

• YEDPA 's major programs have been implemented by 'the nation's CETA 
prim^ sponsor system. , r 

• Innovative,. experiBients have b^pi PUt in place both on- the national 
and local level. > 



, ^ # Research commissioned through YEDPA has greatly expanded knowledge 
about the extent and causes of youth unemployment. 



• For the first time, the y^uth employment system has been brought in- 
to substantial contact with public s^condai;y education. 

• Youth unemployment rates have come down, with YEDPA accounting for 
most of the new jobs gained by minority yputl^s in the past year. 

• Numbers alone do not reveal the remarkable range of local programs. 
The followin^ire^ the specific results of YEDPA: 



A. Public Sector Job. Creation 

• The employment And training system has been capable of adapting to 
. new requirements, of cutting through normally exp6>;ited delays and 
providing youth job opportunities on a larg e scale and rather 



*There are 230,000 youth slots in YEDPA, but nearly 750,000 youths haj^e 
participated because this includes youths who have dropped out or graduated^ 
and then replaced by new enrollees. , 

■ • • V 
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• The majority of youth served by YEDPA are from minority groups. Be- 
tween 1954 and 1977, employment/peculation ratios were almost halved 
for all groups of black youth. Unemployment rates nearly tripled 
(|gom 13f4 to 38.7 percent? for the' 16-17 group and from 14.7 to 36.-1' 
for the 18-19 group) . Some improvenent in black youth labor force 
participation has occurred^in the 1977-1979 period, although official 
jobless rates partially mask the progress by not revealing the extent 
of new young entrants. Over the past two years, for example, the un- 
employment rate for white youth age 16-21 decreased 3.1 percentage 

^ pninte - while they decreased 4.8 points for minority youth. Govern- 
ment of^ficials also note the 20 percent increase in the employment of 
black teenagers ages 16 to 19. They estimate that at least half this 
increase stems from YEDPA and the other federal youth initiatives. A 
'20-year decline in black teenage labor force participation was rje- 
versed for black males ^in the YEDPA period (it increased from 41.1 
percent in 1977 to 47.4 percerft in 1979).* 

♦ 

• Primesponsors have targeted their programs on the economically dis- 
a^vdfitaged 



itaged to a degree greater than required by Y^PA. 

• Work performed under YEDPA has been' shown to have both tangible com- 
munity benefits and genuine economic value 



B. Access to the Private Sector 

There is a growing consensus, on all levels, that private, for-profit 
employers pust be more deeply involved in solving the nation-^ s youth employ- 
ment problems. Based^ on their own identification of needs, large and -sn^iall 
employers require significantly different policy approaches ^ 

• rrhere has ^been no long-term or large-scale test direct wage sub- 
sidies for youth in the private sector,' but the Entitlement has 
shown that direct wage subsidies will attract private sector par- 
ticipation . 

/ * , 

C. Educational^ Strategies and Institutions 

• The 22 percent set'-aside tends to work well as a financial incentive 
} for local Education Agencies td» participate in joint action with the 

prime sponsor . [ * 

» w • Young people previously out of school were attracted to participate 

.in the Entitlement through non-traditional settings, primarily al- 41 
^ ter native schools. 



The YEDPA experience suggests that a more diverse menu of program offerings 
is required in order to meet the different needs* and interests of out-of-O 
school and underachieving* youth. A simple "return-to*-school" formula is po t 
su ^^C^ent ^ ; » . ' 

D. Supportive Services 

.# Rost prime sponsors^have planned and offered a wide array services- 
to> youth participants in YETP, YCCIP, and YlfiPP, 

• Three services^-transportation, child care, and health care — have 
emerged as having an increasing impact on youth empjioyability. 



E. Management » • ^ 

• Prinie sponsors are capable of managing youth programs, even those with 
the scale and -complexity of the Entitlement, though their capability 
varies greatly* 

r 

# The knQwledge development strategy has ^been particularly effective in 
devising innovative delivery approaches (such as interm ediary corpo- 
rations), structuring dismonstration project jf, coordinating basic re- 
search, and increasing awareness of the value of experim entation. 

« YEDPA has led to increased connections between pfime spo nsors and a 
multiplicity of community based and non-T^ofit organ izations. The 
record is less auspicious with unions and pi-ivate employe'ts. 



(IV) ' SOME BACKGROUND ON POLICY IMPLEMENTATION 

The generally effective, implementation of the nine YEDPA prograpns ana- 
lyzed is no mean acccwmplishment in light of the frequent ineffective implemen- 
tation that most <^nalysts of domestic social policy' prc^ams have found.^ 
home brief examples of these historical patterns will serve as a useful back- 
ground and point of contrast for the analysis of the effective ^piemen tation 
of. the nine YEDPA programs. They will also indicate the generic nature of 
'implementation difficulties, which is to say the generic nature of the ample- 
^aentation obstacles which tTOse nine YEDPA programs faced and generally over- 



came. 
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• In 1965 a new agency, the Economic Development Administration (EDA) , 
was established by Congress. .The EDA decided to go into cities for 
the purpose of providing permanent new jobs to minorities through 
economic; development^ In 1966, Oakland was chosen as an experiment' 
in showirig how the provision of public works and building loans can 
provide incentives for ertployers to hire minorities. All partici- 
pants at the local and national levels agreed about the prograln's 
goals; there was %iinimum publicity.' Ample funds were on hand at the 
right time. Congressional appropriations/ EDA commitment of funds^ 
tb Oakland, and approval of local projects by city officials and 
private employers all occurred within a few months. 

* EDA was to provide $23 million in loans and grants to enterprises in 
Oakland which agreed to hire minorities and build facilities leading 
to minority employment for a total of 3^,006 new jobs. The later 
steps of implementation were felt to be "technical questions" that 
would resolve themselves once the initial agreements were negotiated 
and commitments made. Bixt these "technical que^Stiops" provided con- 
tinu'al problems for five year!&. Indeed, three years after EDA en- 
tered Oakland, only $4 million had been spent and only 63 new jobs' 
had been created. After five years, only $12 million had been spent 
and only 900 new jobs had been created (Pressman and WiJ.davsky) .* 

• In 1967 the Johnson administration launched a new program, New Towns 
in-Town JNTIT) , to create model communities on surplusN^f ederal land 
in metropolitan areas. The NITIT's objectives were to demonstrate 
the federal government's commitment to help the nation.' s troubled 
central cities, build new housing for the poor, and to show how much 
could be accomplished by a combination of high level political sup- 
port and imaginative urban planning and new technology. Initial 
agreements by local officials seemed to federal officials to be wide- 
spread. But disagreements rapidly came to ^the 'surface. A number of 
Ibcar groups strongly opposed low income, public housin'g^ local of- 
ficials preferred development plans that would yield more tax revenue; 
and conservationists were opposed t6 any plans for construction T 
Finally, after four years, no new towns had been built apd practically 
none had pven. been started (Derthick) . ^ " 

• In mid-1969, .the Lanterman-Pe,tris Short (L-P-S) Act went into effect 
in California. This law was intended to protect the civil liberties 
of persons alleged to be mentally ill and to accelerate the trend ^ 
toward "community" treatment of the mentally ill as an alternative 

/ to hospitalization in remote state insti1:utions. Implementation of 
half of the legislation, protection of civil liberties and a ^general 
movement toward de-institutj.onalization went well. But the other 
half — provision of outpatient servAices at the community level — was 



♦Authors will be Vjitea in the body of report. See "References", section 
for complete citations. 



very slow, expensive and reached only a portion of those released 
from state institutions. For instance, in San Mateo County (noted 
for having th^ state's most progressive copnunity mental health 
service systein)l of 260 patients discharged between June 1972 and 
December 1973 from Napa State Hospital to San Mateo County, only a 
minority, 107, received followjup mental health services. Another 
-66 received public assistance "welfare'* but no mental health ser- 
vices. (Bar.dach, 1977) ' \ - - 



One of the lessons of the abov^ case^ studies is that at the heart of 

many instances of ineffective implementation is a vicious cycle of delay. 

It often may begin with merely minor disagreements between Dust a^ few actors 

or with the minor delays associated with simple standard operating procedures ^ 

•in bureaucracies. But, in the context which routinely characterizes social 

programs — changing actors, diverse perspectives, and mtiltiple clearance 

points— these delays often lead to the next step in the cycle: ' suspicion 

« 

of ultimate failure or high salvage costs, withdrawal of previous commitments, 
more delay, increased anxieties, more suspicion, withdrawal, further delay, 
and so forth. 

Furthermore, it seems likely that this pattern of ineffective implemen- 
tation is not a recent phenomenon. Most of the Studies documenting this 
pattern are based on programs of the 1960 's and 70' s. But what is new seems 
only to be our more explicit and direct interest in the implementation stage 
of the policy process and our willingness to ask hard questions about the - 
actual effectiveness of implementation efforts. , ^ 

• This pattern of ineffective implementation probably existed before 
the 1960 's because the funaameotal factors underlying it are long- 
-standing elements of our' political system . These factors include 
the fragmentation and dispersion of political power which make im- 
plementation agreement difficult (federalism, local control, shared 
power between separate executive and legislative branches and the ^ 
multiplicity of decision points at all these levels) ; th^ separation 
of policy designers from policy implementers; the annual budget re- 
V view pressure? and biennial or quadrennial election pressures, which 
create demands for instant results and counterproductive implemen- 
tation decisions, e.g. (selecting programs tshat can be processed in the * 
shortest time); vague standards which make- implementation difficult ^ 
but which are almost endemic because legislators rarely can agree on 
more precision and specificity and so they pass the problem on to 
, the implementation stage. . . ' 

10 - • ■ 
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it should be emphasized that these factors which seem to tmderlie 
ineffectiVQ impleroentation invr^o significant dileitrmas. These factors are 
valued characteristics of our political systeirt . The behavior which often 
is associated with ineffective implementation is legitimate* Indeed, it is 
purposive rather than aberrant or pathological behavior ; The actors who 
pursue thib behavior are trying to achieve values that are widely accepted 
in our political culture. However, this involves significant dilemmas be- 
cause at the same time these actions tend to contribute to ineffective im- * 
plementation • 

Some of ting^ dilemmas associated with the factors just noted include the 
fact that the fragmentation of power in -the form of federalism (and especially ^ 
local control) is yidely' valued despite the fact that it makes implementation 
> difficult ♦ Separate executive and legislative branches seem to lead to many 
inefficiencies, especially at the implementation stage. But they are con- 
sidered by many to contribute to sustaining democracy, pluralism, and many ef- 
ficiencies such as providing a pattern of policy oversight that .helps to detect 
and correct policy errors. Separation of policy design from implementation may 
c^ause difficulties but it also gives policy designers the freedom and incentive 
to innovate. The short nin pressures of elections and budget reviews indicate, 
the tension between the need for electoral control over political leaders with- 
in short periods and the much longer period required for policy fruiti,on. 

tVl THE EFFECTIVENESS OF THE IMPLE^NTATION OF THESE NINE PROGRAMS 

The complete details of the degree tb which these nine programs satisfied 
our' three criteria for effective implementation are in Appendix B vdiich^con- 
tains the nine complete case studies, preceded by the abstracts of these case 
studies in Appendix A. suiranaries of the cases are presented here roughly in 
the order of each prograja's effectiveness of implementation (ranked by quar- 
tiles) • There are no exact rankings because the nature of the data does not ^ 
lend itself to such precision. 
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• Very Effective Implementation: Pitl^sburgh's STAY, New Haven's VICI 

• Highly Effective Implementation: Portland's EHR, Syracuse's BOCES- 

Hancock, Albuquerque's THE program 

^ 

• Medium Effective Implementation: Albuquerque's WORP program, Newark's 

. ' IHS , . 

• Borderline Ef f ective-Implementation;__ Baltimore ' s YouthWorks , San _ . 
V ^.^^^ . • - • An^tonio's YCCIP 

We found that all nine programs were effectively implemented and these 
rankings* indicate their varying degree of effective implementation. This 
variation is significant because it seems to be associated with the p^^esence 
or absence of some ofHKe'cbqdit ions /that we found to contribute to effective 
implementation of YEDPA. (Most of these conditions tend to be present in the^ 
programs which were most effectively 'implemented and some of the conditions 
.were missing from some of the programs that were not as effectively implemented. 

These programs are reviewed in terms of our^ three criteria for effective 
impl^entation: (1) minimizing delay ; (2) minimizing financial costs; (3) ^ 
meeting objectives . (Each ^ummary begins with a brief description of the pro- 
gram.) • ' • - ' 

T hese summaries are not evaluations of these programs . Such evaluations 

> — ' : ' I 

would include analyses of the programs' ultimate^ outcomes (the programs' ef- 
fect on the target population) as well as the effectiveness of their implemen-: 
tation. For the reasons detailed in the section (V]j^) of this introduction, 
we cannot fully analyze these ultimate outcomes at this time. 

These 'analyses are based on the programs' operation through May 31, 1979. 

' r 



*Even these quartile rankings afe not exact, and there is an overlap 
between most programs in contiguous categories. But we. are confident in ours 
♦assessment at the poles: The implemfe\itation of the pr6gram in San Antonio 
and Baltimore generally was effective but the implementation of the program 
""iJTT^ew Haven and Pittsburgh was much more effective,, with the implementation 
of the rest of the programs lying somewhere between those poles and gen- 
erally being in the direction of highly effective implanentation.* 

♦ * 
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VERY BPPECTIVE • iMPLEMENTATION v . . 

Pitt^urgh's STAY 

STAY *is a YETP program \*ich is operated by the Pittsbtfrgh Publfc 
Schools^ STAY seeks' to introduce economically and. educationally disadvan- 
taged, in-school youth to the rewards and ri^rs of tSe" world of workT STAY 
consists of work experience, academic instruction about_the world of work, ^ 
and support services, (a) Work q?cperience: an atten^ to provide practical 
job experience for youth who have never worked, (b) Academic instruction: 
teaches STAY paaftt^ipants what is ^required of them in the world of work and 
its rewards for ther/. (c) Support 'services; as^sts the student in dealing 
with personal problems. ^ r 

. , ■ , / , • ■• . 

Delay ; The program began in February, 1978 (the earliest possible date for 
a YETP grpgram) . _ _ - 

Financial costs ; No overruns . > ^ 

Satisfaction^of objectives ; STAY is. ^ large (5^0 participants annually) pro- 
gram that takes the poprest and most academically disadvantaged yoiuth. It is 
highly effective in recruiting the target population v^ich must meet the most 
stringent eligibility requirements of the nine programs analyzed. -YETP allows 
participants to have a family income of up to 85 i)ercent of DOL's lower living 
standard. But STAY'S requirement is more stringent— a family income not high- 

er'thah 70 percent of DOL's lower «living standard. STAY also introduced the 

— , . . . ^ ^ 

recjuirement of having a two-year academic average below a "C*^* 

Job experiepce i^ cru^cial to the success of such a. program, and job de- 
velopment is a very difficult task for^ these programs to achieve. STAY has - 
been highly effective in developing a large number (approximately 35) of ht^h 
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quality publi« sector job §ites* which must meet the following two criteria: 
■(d)' theore is a job for the student to do; (b) the student is well fcervised.* 

* Foi the first, fall semester (the only one for which data are now- avail- 
able) 65 percent of participants completed am, 11^2 of the 231 initial 
enrollees). And 47 percent (72 of the 152) of thei got private sector jobs 
within three iinoilths of program completion.- 

. • tJev^ Haven ' s VICI 

New Haven's VICI began in OctoBe^ of 1978. it is funded thrdugh the 
Corporation for Pifblic and Private Ventures iCPPV) . Its design was modeled 
after Emergency Home Repair, a pre--!ffiDPA program in Portland, Oregon. It 
enrolls approximately 55 out-of-school youth to perform rehab and weatheri- 
zation on private, owner-occupied homes in low-income neighborhoods. The 
worksites and the supplies are provided by five city agencies. Supervisors^ 
are unioh carpenters and painters, vrtib instruct as well. 



*When he developed the program, STAY'S director, Fred Monaco, decided 
that it should-have exclusive use 5f the 35, or so best public sector Dob 
sites developed ove.r the yeats by its predecessors, the SET/AVERT programs. 
(As we will detail below, SET/AVERT are programs Sn th,e Pittsburgh public 
schools begun in 1971 by kred. Monaco and designed to provide low-income • in- 
sch^l youth permanjjnt part-time emj^loyment. STAY- was de'si^ned to deal with, 
the types of youths who dropped out of SET/AVERT.) Monaco- reasoned that 
since the participants of the STAY program faced multiple barriers to employ- 
ment, in order for the program to work at all/ the work experience component 
of STAY would have to be of high quality. - * ' 

'**STAY students work ih- hospital dietary sections, school custodial jobs 
the YMCA /recreation department. , Unlike "THE" .in Albuquerque, STAY neither 
expects 'kor hopes that stiicjents will be hired by these agencies. The -aim of 
STAY is t(f take students who haVe ^never Worked and who would proijably have 
dropped^ftOL of the SET/AVERT program and let them experience the world of , 
.work. TTflSi who 'successfully 'complete^TAY are channeled into SET/AVERT and 



access to higher quality, jobs -with^future^ employment possibilities. 
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Delay : The program, began two weeks after RDOL (Boston) signed the contract in 

/ • 1 

Septeini^er.* ^ * ^ 

Financial Costs : No overruns^ But because of slight underenrollment In the 
program (see below), there has been slight underspending on both participant 
wages and the administrative component. / 

^>tisfaction of objectives ; ^ Minor problems in the skill -training component 
were :^emedied through effective error detection^ahd swift error correction: 
there was initial overemphasis* on achieving job productivity through many 
small jobs which could be completed quickly. But this offered participants 
^a lesser menu of skill experiences. The prtgram director shifted the policy 
to lai^ger worksites' which offered a broader variety of skill experience. 
Under both the small and large job site policies, the program's coiranunity ilBt 
provement objective also has been effectively achieved. 

Post-prograift placement in apprenticeship programs initially did not meet 
projections because^of factors beyond the program control — New Haven's tight 
labor market. While" still making union placements, the program hag coped with 
^ this by also successfully focusing on non-union placements. 

It also should be noted that the New Haven VICI program is one that the 
general implementation literature (summarized, above) would predict would be ^ 
implemented ineffectively: t*irst, though there were signi^cant design inputs 
made by the locals, this program was essentially a national design (based on 
the very different context, of Portland, Oregon) .being brought to a locality. 
The liter^ure suggests that this generally makes implementation difficult. 
Second, as both the "Analysis and Recommendation" section and Appendix B will 
indicate,' the New Haven program also faced more than an average amount of po- 
tential implementation difficulties. Given this background, the prograitf's 
"effective implementation is all the more significant. 



*This was three months after New riaven's proposal had h|0^ approved ^y ^ 
CPPV. &ut New Haven experienced less delay than five of the eight Vlcl^prO- f 
grams administered by CPPV; the ot^er two experienced only two weeks less de- 
lay than New Haven. 
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HIGHLY EFFECTIVE IMPLEMENTATION 

Portland's ESR (Emergency Home Repair) ' . 

EHR i§ a work experience program serving in-^chool and^od?-of-school 
youth. Begun in 1974, the program has since become a YETP program combin- 
ing funds from DOL, HUD, the school did^rict and thq, city. The prograhi ik 
contracted out to the Portland ^Public Schools Who hire personnel, recruit . * 
in-school yduth, and provide a headquarters. Supportive services and re- 
cruitment of out-of -school youth is done by the city through CETA. The 
program receives its worksites and supplies from the Portland Development 
Coiraaission (private^ owner-occupied homes of the poor, handicapped and el- 
derly) . Youths perform emergency rehirb under the supervision of public 

school teachers with construction backgrounds. 

r I 

Delay: The program began less than one month after, the proposal was ac- 

Financial costs r No overruns on an annual budget of $400,000 (including in- 
kind services of school district and city personnell . 

S atisfaction of objectives ; EHR's projected enrollm ent has been achieved (anr 
average of 38 of the 40 projected youths) through strong decentralized rfeciruit- 
ment procedures (each high school\as its own work experiencie coordinator who 
refers youth to this and other programs) . ' But the absence of any screening • ^ 
standards for referrals resulted in a ve^y high participant turnover rate. 
This was later remedied by the personal J^nterviewing, of each applicant by the 
program dingctor which resulted in an almost 70 percent' reduction in parti- ^ 
cipant .turnover. The target of 'economically disadvantaged youth has been \ 
achieved! *But 'in ^ contrast to I^ittsburgh, EHR has used the higher standard , 
tf amily income under 85 percent of the DOL lower living standard) . The com- 
munity improvement objective'has also .been -satisfied. 



♦Several months later the program closed doWn while the agreement with 
the school district ^as^being fin^li^edt. But it only took three weeks to \ 
start it up a^ai^n. - , ' ^ 
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^HR had significant administrative dif ficiilties in its early stages. 
But even in the short run 'they had little effect on program participants. 
(This contrasts with San Antonio and Baltimore where similar difficultife^, 
did adversely affect participants in the short run.) Moreover these dif- 
ficulties were overcome relatively soon, which' is one of the charact^risr 
tics of effective implementation. EHI^ has been operating long enough to 
obtain placement data. I^jast year^ the program had a positive termination 
rate of 60 percent with approximately half going into uhsubsidized emplo^- 
mdnt and the other half obtaining further training outside the prograA. 

Th6 noteworthy aspect of the potential difficulties. facing the Port- 
land program is that when it began (in its pre-YEDPA stage) , it was a com- 
pletely new and rather innovative idea. Again, on this basis one would 
predict, ineffective implementation, yet EHR was highly effective. " ) 

\ ... ' • - 

^ ^Syracuse's BOCES^Hancock 



This YfeTP formula-funded program serving out-of -school youth, wht^lr 
began in November/ 1978^ under agreements between the City of ' Syracuse 
(Office of Federal and State Aid Coordinator - OFSAC) , the Air National 
Guard (ANG) , and the Board of Cooperative EducationaT Services (BOCES) with 
cin enrollment of ^0-25 youths, is conducted at the National Guard quarters / 
of the Hancock Air Force Base. The youths receive on-the-jol^ training in a 
wide variety of fields, under the supervision of Guardsmen, and rWedial 
reading instruction from a BOCES teacher. ^ 

Delay ; ' The program' began within two weeks of initia<L target date. 
* 

Financial Cpsts : No overruns. Indeed, this is a very low cost program. 
Many youth programs wi£h a skills training comx)oneat receive free worksites, 
but th^ have to purchasev supplies and malierials and, pay supervisprs • sala- 
ries.. By contrast, the ^Syracuse prime sx)onsor (the city government through 
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its Office of Federal and State Aid epordinatb^ OFSAC ) negotiated, an agree-^ 
ment with a state agency, the Air National Guird, to ^ec\^ all of these ele- 
ments^ including skilled technicians as supecAsors) at no costs. The only 
cost^fjt:o the prime sponsor are a classroom,, cpitiponent^ i^^^fSif^ annually) ^nd" 
participants' wages. 

Satisfaction of objectives : The prpgram has^not had any problems recruiting 
low income and" minority youth. But with an fenrpllment of 20-25, it has never 
reached its target of 30 participants. Placement data were not available be- 
caus^the program is still in it;s first term. But impressionistic evidence 
indicates that the implementation of the OJT skills component has gofie well. 
The remedial ^ucation component met resistance froio the participants, most 
of whom believe that they do not need it because^hey- are high school cprad- 
uates. However, .adjustmtots in this curriculum have reduced this resistance. 



Just as ^ajor potential difficulties faced the New Haven program, it 
should be noted that the opposite was true for this program: For « instance, 
its objectives are' modeat—a small pirografti (for a maximum pf 30 participants) 
aimed a4^- group with better-than-ayerage ^ucational credentials—high 
school' i^raduates . ' ^ ' ' ^ " . *^ ^ 

ilv, ' . Albtiqu^que * s THE Program 

THE Is a YETP operation run by t;j^,e;Albuquer(3ue Public Schools (APS)\ 
serving in-school youth, THE consists of- (ar.Job.^%perie^e» participants in 
the program are placed in one of five Albuquerqutl^tels and given hands-on 
instruction, in each of five areas of tHfe hotel operation, (b) Academic instruc 
struction: students attend twice weekli^ clas^^TdiS^t^ with the requirement^, 
rewards, and problems of the world of work/ (c) %PPDr\ services: help stu- 
dents deal with personal problems. 

Delay ; The program began in. Fe^ryary 1978 (yie^arliest possible date for a 
YETP program) . * C / • ' 3 
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Financial costs : No overruns. In fact, despite initial difficulties over 
negotiations with the hotels over their training fee (see belbij) , two of 
the six hotels never billed the program at all. 



Satisfaction of objectives ; THE has achieved over 95 percent of its target 
90 participants. It did this by .overcoming initial recruitment difficulties 
(the necessity of the counselot making several trips to each guidaoce coun- 
selor to explain and sell the program) . It has also achieved the target of 
fdmily inqome no higher than 85 per9ent of the DOL lower living standard, 
which required a waiver by the ^prjjne^ sponsor because the prime's initial tar- 
get was the 70 perceht level. ^ 



But THE has not. been effective in the recruitment of academically disad- 
vantaged youths — potential dropouts. It has no specific recruitment system 
for^this and 'no entrance requirement suclws Pittsburgh's of a below C aca- 
demic average. The training objective is very effectively achieved. THE 
provid^ some of the most significant training *of th^ nine programs analyzed 
befcause^relatively rapid advancement is possible in the hotel industry, es- 
pecially in Albuquerque where it is strong and growirig, "^THE's initial place- 
ment record of 80 percent was strong but the following semester it dropped 
tQ between 40 and 50 percent.* < * 

MEDIUM EFFECTI\yE IMPLEMENTATION 



Albuquertjue' s WORP 

As a (Tier II) Entitlement pr,ogi:;^m, WORP "entitles" any etigible youth 
living in a geographically defined areas to a part time job during the 
school year and a full time job during the summer as long as thg^ youth re- 
mains in school. Participants can also earn credit" toward graduation by en- 



*This may be due to seasonal raployment fluctuations in the hotel in- 
dustry and the directories contention that TOE began to attract more disad- 
vantaged partipipants^ 
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rolling 'in WORP (listed in the school catalogue as an elective). Once eli- 
gibility is certified, y6uths are assigned a WORP Counselor who informs them 
of their rights and responsibilities and helps them select a job from WORP's 
available pool. • 

Dei^y ; The program experienced modest but troublesome delay receiving the 
grant award.. Thus, the program had to begin after the start of the school 
semester which heightened the pressure to enroll youths rapidly and move them , 
on to worksites. But t\ie main significance of this delay for the /issue of ef- 
fective implementation is that the program was able to effectively gain the 
school system's cooperation ^ makingj the adjustments to the late start-up 
date which was out of phase with the school calendar. ^ , 

Financial costs ; No overruns. Moreover, the program has been ab3^ to allocate 
more than the required amount on participant wages (77 percent of the total bud- 
get) because of its ability to obtain worksite supervisors at no cost to the 
program.* 

satisfaction of objectives ; Th6 program has reached 80 percent of i^b pro- 
jected enrollment. But it has not been effective in reaching school dropouts. 

"°The initial target was that 10 percent of entitlement eligible youths would be 
dropouts, but the program has only enrolled 5 percen.t. (Baltimore, by contrast 
has achieved its target of enrolling dropouts to the level of 20 percent of its 
/total enrollment.) Unlike most entitlement programs, WORP has been successful, 

>^ however, in gaining the award of anemic credit , for work experience.- But it , 
has not achieved the YIEPP ohje^B of job 'development in the private sector , 
.which is significant ixJth^at^ially and symbolically for YIEPP. WORP's two 
worksites-the University of New Mexico and Kirtland Ai^\Force Base-have sev- 
eral advantages which will will discuss below. Nevertheless, they dp not of- 
fer private sector experience or direct future placement. 



vifThis also permits the proaram to pay counselors according to the public 

school saLry schedules withou/the strain on other portions of the administra- 
tive budget experienced in other YEDPA programs. 
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Newark's Independence High School (IHS) 

IHS is a private, non-profit, alternative school which seeks to integrate 
its "Academic curriculum with practical work experience in order to assist aca- 
demically, socially, and economically dis'advantaged youth. The student alter- 
nates between nine weeks of academic instruction with heavy emphasis on reading 
and math and nine weeks of work in an area of employment in which the student 
Has expressed some interest. In addition to work experience and academic in- 
^ struction, IHS also has a social service department for aid with personal prob- 



Delay : The orogram began on^ime at the start of the school year. ^ IHS was 
"awarded its $^00,000 grant DOL in August 1978. But because of conflicts 
with the prime sponsor (detailed below) , the contract was not signed until 
October 1 and f^ui^ds were not, received 'until the end of October. IHS's iti- 
tensely d'fedicated staff went for over a month without pay in order to have 
the program begin on time. • 

Financial costs ; The original grant was increased by $56,000 to solve a prob- 
lem with the program's work experience component. It should be noted, howevery 
that IHS was willing to forego this increase and operate the program differently. 
It received the money at DOL's insistence. 

Satisfaction of objectives ; Recruitment is not a problem at IHS. It has a 
waiting list of 25(5 youths for 100 positions. It has also achieved its target 
of youths with previous difficulties both in and out of school; Over half of 
the student body were expelled or dropped* out of a previous high school and 
almost half have arrest records. 



IHS was not abJLe to meet DOL family income qualifications and had to re- 
ceive a waiver from the prime sponsor which involved a fair amount of conflict 
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between IHS.and the prime.* Satisfying objectives of overall implementatidn 
progress, IHS was able to 'resolve the ctjhflict in its own favor and with only 
a small amount of delay. But the fact remains that the -family income objec- 
tive was underachieved by quite a bit since the waiver for IHS allowed it to 
.go beyond not only the 70 percent level (the initial target) but also l^ie 85 
percent level. Similar conflicts between IHS.and the prime sponsor and IHS 
and POL characterized several elements of the implementation process. But 
unlike the one over income eligibility these did not result in any other sub- 
- stantial underachievement of objectives. But t*here was ^ good deal of bureau- 
cratic* implementation difficulty with which IHS was only moderately adept-at 
handling. However ^ as in the Portland case, with a minor exception these 
difficulties in Newark have not yet adversely affected the participants or 
the substance of the program. 
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' ' IHS has had some small problems in retaining all of its private sector 
employers because of DOL's- successful insistence that these employers would 
have to fulfill DOL requirements and pay on6-half of the wage bill.** 



*In its initial proposal IHS had agreed to serve only students whosg 
■"family income was 70 percent of the lower lining standard. However, the 
subsequent income verification found there were a number of students at IHS 
whose family income was as high as 85 percent of the lower living standard. 
The pr4jDe told IHS to take these students off .the work experience -component 
and that the prime oluld no longer pay for them. After several weeks of poh- 
flict and negotiation, IHS received a waiver to go beyond not only the 70 
percent level but also the 85 percent level. iE 



- **IHS's initial proposal had stipulated that in their YETP program they 
would continue their tradition of having the youths paid either no wages for 
their work experience component or wages below the minimum wage. IHS ini- 
tially rejected DOL's^ insistence on both paying the minimum wage and the em- 
ployers paying ^ne-h^f of the wSge bill. They said that this conflated With 
the scho^s image as\n inngy&tive educational experience rather than an em- 
ployment agency and ttJti*-<ouid caus? the school \o lo^ie all of its private 
sector employersr~Months of pre- and post-proposal negotiations resulted m 
IHS acquiescence teethe DOL requirement and DOL' s -increasing the grant by 
$56,000 to cover this element. 



The academic instruction component ha^ been implemented effectively and ' 
^is well integrated with the work experience comppnent. Average school attend-: 
ance is approximately 80 percent and average job attendance^ is 90 percent. 
The separate Career Develojnnent Seminar, vAiich is designed to explore issues 
surrounding the world of work, has hot been effective. It requires the type 
of^^daptations that were made in a similar class in Pittsburgh's STAY program. 
But unlike Pittsburgh, these have not been implemented as yet at IHS. 

(' 

-Unlike most of the othei: programs, the ultimate goal at IHS is graduation 
from the school rather t|ian simply job placement. After, only one year of the 
YETP prograijt^here are insufficient data on its possible effect on the school's 
dropout rate or post-graduation job placement. 

BORDERLINE EFFECTIVE' IMPLEMENTATION 

Baltimore's YouthWorks 

This is^a YIEPP (Entitlement) program placing 7,000 youths in part time 
jobs during the school year and full time jobs during the summer so long as the 
participant remains in school. The majority of the youth (pyer 80%) are placed , 
in either public sector or private non-profit jobs.- The remaining 10% are 
placed in private sector jobs with most -of these plac^ents coming from sma^l 
"ma and pa" bu^nesses rather than larger, corporate operations*. 

Delay : The program was only moderately successful in avoiding deLay. Place- 
ment of enrollees in jobs was delayed by ^ the program's inability ^to cope with 
the very large initial volume and subsequent continuous enrollments; After 
one month of operation, 6,000 youths had been enrolled but only 35 percent of . 
them had receive^ assignments, six months later this figure had -been increased 
to 83 percent. But this compares to a 99 percent job assignment rate in 
Albuquerque's entitlement ^program (though the latter is the highest rate for 
any entitlement program) . These delays in Baltimore were reduced by eventually 
rfeplacin^ cthe contiriuous enrollments with a monthly assignment system. The pro- 
grammatic and organizational difficulties, which will be noted shortly, occurred 
SO early in BaUiimore that they ^further contributed to implementation delay. 
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Pi'nancial coata ; To remain within its budget, YopthWorks had to negotiate 

an increase (from approximately $3 million in the first 18 months to $5 mil- 

li6n for its one year extension period) ih DOL funding to pay additional 

staff necessitated by implementation, difficulties and the elimination of PSEs 

from direct sy^rvice delivery positions. Furthermore, another element of the 

financial costs was'only held to a rksonal/le level because MDRC made^a special 

' ' ' ' (> 

adjustment for YouthWorks.* 

Satisfaction of Objectives ; The program has been generally successful in 
meeting its projected enrollment levels. One month after the "program began, 
in March 1978,' 6,000 youths (99 J)ercent of projections) were enrolled. Enroll-^ 
ment levels held at between 80 to 85 percent of projections in the first sum- 
mer and rose to 95 percent in the fall. -Twenty percent of its eprollees are 
dropouts, which is much greater than Albuquerque's 5 percent. YouthWorfks has ^ 
met its target of placing 10 percent of its participants in private sector 
worksites. However, to meet this goal, the program shifted from its early ■ 
emphasis on corporate and institutional, job development to a focus on "ma and 
pa" service and retail businesses.** Whether this ^hift will lessen the pro- 
gram's ability to achieve its goals of meaningful work experience and future 
job opportunities must await a comparison of placement -outcomes between pro- 
grams which provide work experience iri'the small business and large corporate 
sectors. « ' ^ 



*As Will be detailed later, after the increased funding for additional 
staff YouthWorks- wojld not have" been able .to ranain within the restriction 
Spring thlt 65 percent Of budget be paid t^'p.rticipants unless YouthWorks 
was P^^itted -to de<^uct funds received fox "enrichment activities" from its 
administrative budget in computing those percentages. 

**Corporate placem ents raised probFems in terms of P^^^^^^f . ^^J^J^^^^f 

of union iSbor and employer intolerance of youths with ;f , 

small business sector demonstrated greater willingness to put time and effort 
Tti training youths in return for useful free labor. The -""^ °^,^^J^_3,^,3 
crime sponsor, MOMR', that it establish a good relationship with the large-scale 
bu"nesrsect;r in ;rder to meet other organizational goals also seems to have 
been a factor in this shift. 
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Breakdowns in the par ticlpatit payroll systQ[R_<3uring the first few months 
of operation .created many citizen' complaints to the Mayor's Office and MOMR 
as well as bad press publicity. It is estimated that only between 300 and 600 . 
participants were not paid on time out of a total of 6,000. But this is large 
in absolute t^rms and enough to generate a good deal of bad publicity informally 
and in the media. Also, employers became discour>aged when youths assigned to 
them were not paid. 

This triggered a swift response from Marion Pines, MOMR director, and 
Robert Iv»y, MOMR youth services manager. These and other acjininistrative dif- 
ficulties^ were detected and overcome through two strenuous reorganization ef- 
forts, which is a characteristic of effective implementation. Indeed, these 
successful detection and correction efforts and the substantive improvements 
that they created are one of the major reasons that we consider the Baltimore 
program to be effectively implemented despite its other limitations. Nonethe- 

less, it should be emphasized that these administrative difficulties reduced 
» *- 

the effectiveness of the program's implementation because they were relatively 
numerous, sizable, . and ^ they affected the participants in the program^ In all 
these respects they differ from the administrative difficulties in the Portland 
program. For instance, intake was halted for a month while the reorganization 
took place. Our conclusions here are confirmed by MDRC's similar findings.* 

Finally, i,n asses^sing the implementation effectiveness of YouthWorks, its 
large number of participants and other ambitious goals should be considered as' 
major positive elements. ' ^ 



*MDRC praises Baltimore's YouthWorks as a leader amongTIrTtitlement programs 
in organization, ability to recruit participants, and absence of conflict be- 
tween schools and the prime. But MDRC goes on to note that ma jor reorganization 
was necessitated by the initial inaccurate belief that its summer SPEDY staff , 
could run Entitlement, y^ong other things, MDRC found that the reorganization 
caused YouthWorks to halt intake for one month. "The Youth Entitlement Demon- 
stration: An Interim Report in Implementation, " MDRC, April 1979. 
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TherMexican American Unity Council (MAUC) of San Antonio operates a 
YCCIP which offers training .to economically disadvantaged high school drop- 
outs between the ages of Iff-lS in the building and construction trades, in 
addition to on-the-job' training, each participant repeives two weekly das^ses 
in construction techniques and monthly employment and personal counseling ses- 
sions. 'Each -participant is offered four hours of academic instruction leading 
to a GED. participation in ■ the GED class is voluntary but. nearly three-fourths 
of participants attend. The work done by the participants is confined to a 20- 
^block low income area and consists of weather ization, landscaping and home im-. 
provements. The program is run by hispanics and it helps hispanics help their 
community. 

. Delay : The program began slowly and experienced several significant deUys. 
It was scheduled to begin in February 1978, and reached its peak enrollment of 
100 youths in April. After an initial 50 youths and five supervisors were , 

■brought on, the YCCIP ran into tr'quble i^ enrolling youths and hiring union 
supervisors. Slow applicant processing and poor screening delayed progress 
tdward enrollment projections. Youths were admitted to the yCCIP without careful 

■ screening. Thus, there was a large number of dropouts because of drug or alcohol 
.abuse or wV.o were picked up by police at job sites for prior offenses or 
court proceedings. Turnover a^nong newly-hired CETA staff (along with inade- 
quate operation procedures and training) exacerbated these problems. During 
the spring the program was *hut down for ^ee weeks while negotiations w.th 
unions concerning pay and working arrang4Jnts for journeymen supervisors 
were concluded. Finally, an agreement on kring additional union supervisors 
was not completed until July. Youths could. not be admitted until additional ^ 

supervisors were hired. 

. pinancial co.ts : San Antonio YCCIP has had problems in meeting its budgetary 
objectives. During what we will call the program's first phase (prior to xts 
significant reorganization) , participant expenditures were below the required 
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A®^l,.eL.^5„pexc^^ renched 1:hB 55 percexrtr 

lefvel. Difficulties have continued in phase two. As late as March 1979, the 
program *still w^s $30,000 over its administrative budget. However, recent ef- 
forts have raised participant expenditure levels ta about 63 perceivt. * 

This budgetary imbalance seems to have occurred "because MAUC did not an- 
ticipate the high cost^of union supervision. Throughout this report we will 
^e anticipation as an essential factor in overcoming implementation obstacles. 
Also, youth absenteeism reduced wage expenditures because youths are ojly 
paid for hours worked. There were also cost overruns in the weatherization * 
expenditures. Subsequent improved procedures and careful monitoring have 
vif-tually eliminated these overruns. ^ 

Satisfaction of objectives ; The 6arly stage of ^the prografti was marred by ad- 
ministrative confusion and a failure to meet objectives. MAUC's executive 
director, Ju^an Patlan, did not respond to signs of trouble with the YCCIP un- 
til there was a low HUD ranking of the program. Then, in the Fall bf 1978, 
the program underwent a major reorganization after Patlan used th^ resources 
of two top staff -people to analyze the YCCIP 's difficulties and recommend 
solutions. YCCIPls first director—an inexperienced former ?4AUC investment 
manager—was then replaced by MAUC's youth services coordinator,' Maggie 
^ Eureste. She was given major administrative support from Patlan and his staff. 
Wit^h this help, she and the, new YCCIP staff increased significantly the ef- 
fectiveness of the program's implementation. "'"'^---^ 

By June 1979, YCCIP had enrolled' 98 percent of its projected 257 youths 
and had long waiting lists for work projects. It also enrolled 93 percent of 
its target for females (70. youths), a significant accomt>lishment in a program 
^n^de up largely of hispa;iics and focused ofi the traditionally male building 
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trades . 



In phase one, institutional coiranunity improvement, proj'^cts were em{>hasized 
at the expense of other project goals. Large, institutional projects were sim- 
pier to administer (supplies vere provided by the* institution) and to schedule 
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(projects were long-term). However, residential repair, rehaBilitation and 
weatherization objectives had- been in YCCIP's dejfeign to respond to coifimunity 
nfeeds other than youth job training, '"^hus YCCIll later discontinued insti- ' - 
tutional pr^ects and directed its efforts to meUing the original mix of 
construction goals. 

^ • ^ : . " , ' 

Placements and temlinations initially have. been close to projected goals. 
As Of June. 1979, there was positive termination for 48 percent of participants 
(85 youths), which Ws 89 percent of projected, goal terminations. Eighteen 
youths have been placed in union apprenticeships which is within the range of 
the program's goal, of 25 union pl'&cements. ^ 



Staff recruitment and hiring has bj^en^a_sexioii^roblegi, which has not 
been fully resolved. In addiion to problems with CETA staff, turnover among 
the core professional staff occurred frequently during the program's first 
phase and personnel problems contihue.* 

• A final word on the significance of implementation effectiveness of 
these nine programs. As noted, these are pnly approximate estimates 
of their relative. implementation ,ef fpctiveness. We ate more confir 
dent about the rankings at the poles than any specific ranking be- , 
tween the programs. But' these approximations should suffice to in- 
dicate the variation- among thf programs in implementation effective- 



ness. 



Furthermore, the reader is cautioned to recall that th e purpose pf 
our analysis is no t to rank these programs. Rather, it is to sugg est 

Tnrv^el of the vagious com ponents and processes ot a YEDP^ program 
v,h^n h wnnid contribute to its effecti v e implementation. Analysis ot 
all nine of these programs was useful in this be cause on the whole 
all were effectively implemented . 

Finally, we wi-^h t,o emphasize our conclusion that the ability of these \ 
ninp yS>PA program, to cope rai -h.r effectively with their amplementation 
difficulties represents significant, though incremental, progress for 
domestic social initiatives. _ 



*At this time, it is not ^ssible to determine the extent to which con- ^ 
tinuing personnel problems are the result of decisions made before the program s 
reorganization. However, it seems likely that reliance on CE?A staff is at 



reorganization 
least partly responsible 
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(VI) THE DEVELOPMENT OF A SOCIAL POLICY -INFRASTRifl^RE AT THE LOC^ 

^ We found that the conditions in 1979 surrounding the implementation of 
•YEDPA -(and similar' domestic programs) seem to be significantly more favorable 
for^effective implementation than they were fifteen or even ten years ago,, 
especially local conditions. ■ Thus, jnany of our recommendations are more 
feasible today than in the past. They are based on programs^hat are mor^^ 
replicable than in the past because these favorable conditions are more wide- 
spread now. 

• ♦ 

(A) As Sar Levitan has argued, actors and deslane ns.^t ^ hh the Federal and 
local level learned a lot about designing and implementing social policy dur- 
ing the 1960*s and 70* s (Levitan, 1976).* 

• I" addit ion to this learning, in the past fifteen years a>ric|i and de- 
veloped gocial policy infrastructure has grown up at the local level . 

• The individuals and organizations which comprise this infrastructure 
Are oriented toward innovation and socialprogress. Many are alumni of 

. Great Society programs and their spin-offs via foundations. Others 
are alumni o5 po^t-Great Society igii^ovative o r^ ^^s of DOL and HUD. ' 

; The accumulated experiences of these programs hlVe produeed-a-great - 
deal of learning for individuals »and organizations. 

» , * 

Many of these persons We still young, but they have learned much from 
these previous varied experieft^s. They represent a new class of activi^st 
bureaucrats. Organizers is a, good functional description of them and liken- 
ing them to community or_J.abor organizers captures a good deal of their backr 
ground and personal predilection. However, they play a larger role and their 
"positioning" is broader: for instance, they are bureaucrats. | They are npt • 
just inside the "sys.tem" ar^d established, they are also government officials. 



*One of Levitan* s conclusions is that "new and experimental efforts will 
^l^^lly come up wanting when compared to longstanding programs. A longer time 
period encompassing the evolution of the more successful approaches, the re- 
trenchment of the less successful, as well as implementation of needed reforms 
is required to get an adequate perspective" (The Promise of Greatness/ p. 2 
277). 




. [• / ■, 

• But we wish to "stress the organizational rather than personal ele- 
- ments, and this is why we use the word"" infrastructure" . We also 

found rich organizational ^development. These organizations are - 
I'established" . ^ . * 

These persons have helped to develop numerous Community based organizations 
(CBO's) as well as new public agencies '(or special programs within them). 
These organizations are experienced, effective, and relaWely prosperous. 
They know how tb" develop monetary and political support. 

(B) This growth in local organizational in frastructure has produced complex 
organizational and personal networks that link p e rsons and organizations and 
give them overlapping interests. These netwrks h ave grown over time and • 
are built on past relationships and trust. All o f this greatly facilitates 
securing joint action and program ass e mbly. They smooth the way for effective 
implementa>4o" • . 

The devei\ent of these -networks which row facilitate program assembly 
is seen in the close cooperative working relationship in Pittsburgh between 
^e assistant director of the Prime Sponsor, P}iil Shugar, and Fred Monaco, • 
the director of STAY. During the late i960's and eariy 70's, Shugar arid Mdnaco 
vrorked together on" a regular basis when both were Neighborhood touth Corps 
counselors in Pittsburgh. . ' * 

In Albuquerque, linkage between key actors in each organization was al- ^ 
ready in place before the development of WORP. OCETA youth program head, Carlos 
Duran and" the APS (Albuquerque pWic Schools) OCETA liaison. Jack Kaemper, had 
first worked together in the Neighborhood Youth Corps in the late 1960'^. J 
Romero, the high school principal, had worked with OCETA through the School on 
Wheels. Contreras, WORP coordinator, had been a participant in an early man- 
, powet program and' then headed a youth manpower program for the Albuquerque 
public schools. Finally, the mayor of Albuquerque had once headed OCETA. 
These earlier experiences^ formed mutual associations which developed a common 
\view on program operation and a^^dency to call on c^e another to deal witu 
•routine implementation problems whiVif unresolved can lead to major failures. 
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For Instance, the delay in, receiving the grant award' required JJQBP to begin 
enrolling students after the start of the school term. But when Romero was 
informed of the delay, he directed his staff to make the necessary adjust- 
ments for this and .other program needs. 

» • 
Similarly,^ in Portland over sevjeral years the exchange of personnel. in- 
volving several persons between the school district and the prim^sponsors 
has contributed to informal working relationships which have aided implemen- 
tation. In New Haven, Al Rogers, the assistant director of VICI, had a pre- 
vious background in construction which provided hiii\^with many contacts with 

the building trades and the work-providing agencies. These lent general 

ft 

creditability to VICI and helped get past many implementation obstacles. 
For example, this removed much of Jackson's initial skepticism about "another 
CETA program" and also facilitated^ the assembly of worksite day-to-day opera- 
tion (e.g., a willingness to short-circuit the normally time-consuming supply 
requisition^ and ordering process). 



/ 



Before beisioming director of MQMR (the Mayx)r's Office of Manpower Resources) 
the'' prime spbnsor of Baltimore's YouthWorks, Marion Pines was a key figure in 
Baltimo^re's Job Corps demonstration program and a member of ±he Maryland Health, 
and welfare Council. There she developed linkage? throughouK^e city and^^at^ 
the federal level which have aided MOMR and YouthWorks,. especially in obtaining 
both federal fundiiig and a sympathet:ic federal 'response to' the common implemen-^ 
tation adjustment \wid adaptation problems,. Similarly, in San Antonio the links 
with Washington^ctivist network 4|b. g. , with^sgr. Baroni) of Juan Patlan^-the 
executive director of MAUC, both aided it in getting the initial YEDPA grant 
and in MAUC'.s relationships With the city government. 



(C) Networks have developed that link organizations as we^^as individuals 



The programs in .Portland, Syracuse, and San Antonio provide^examples of this 

kind of organizational infrastructure that has developed locally since the 

» 

1^60' s and has contr;ibuted to effective YEDPA »impleinentation*. 
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For almost twenty y^rs PorWand has had a h istory ^of Wadvi^^ council' 
vftiich ha3 effectively brought together representatives of labor, industry, the 
city, and the. schools to improve the fit between vocational education councils 
and industry needs. Equally important for a YEDPA program, the counqil's la- 
tent function has been the creation of what amounts to a supportive Ihf rastruc- 
ture among these groups for endeavors such as EHR. • ^ ' _ 

The priority status fhat the prime sponsor in Syracuse, OFSAC, and its 
director, Ann Michel, have, given youth programs such as .BOCES-Hancock seems to 
have aided implementation significantly. OFSAC represents an instance of a - 
more -formally developed piece of local infrastructure than in, Portland. OFSAC, 
established in 1970 by Michel^, was initially a division of the mayor's office 
and -is now a separate city department. It controls all federal and state funds 
that Syracuse receives. OFSAC has grown into a very strong local organization 
because of its ability to obtaig new money for the c^ty. Moreover, it has ex- 
'erciseciVa good deal -of budgetary control and demandei^ overall accountability 
of its programs, and in 'turn, has been able to protect several controversial 

■ . i 

programs . ' 

In San Antonio, the relevant and helpful new infrastructure isdn.the 
. Hispanic community rather than in municijSal institutions. MAUC, thf prime 
sponsor of the YCCIP program, is an influential CDC founded in 1967. -MAUC is 
not dependent on the support of Ibcal political, institutions for its survival. 
With the close cooperation* of the Roman Catholic parishes in the South and 
west sides of the city, MAUC has help4d the Hispanic community's economic de- 
velopment. » > " ^ 

(D) For YEDPA, a good- deal of this learniit^, experience, infrastructure and 
many outstanding" alumni have come directly and indirectly from CETA an^ earlier 
manpower programs.' YEDPA has benefited greatly- from' CETA' s positive and nega- 
tive lessons. If there never had been a CETA program (or any of its predeces- 
sors such as MDTA and NYC) , development and implementation of YEDPA probably 
would have been slower and "less .effective; there wouM have been more learning ^ 
on the job; there wbuld have been less of what wl^will describe as an 



experienced program manager's ability to anticipate implementation pitfalls 
and develop ways 'of avoiding, coping or overcoming them. 

For instance, Sally Coniiolly, the <?irector of New Haven's VICI, had pre- 
viously had a good deal of experience administering CETA programs in New Haven. 
Several of her successful implementations that are despribed below seem to have 
been developed from her previous experience. Similar ly> Joan Coria, the of- 
ficial director of the Syracuse program, previously had a good deal of experi- 
ence in SYS (Syracuse Youth Services). The program's de facto director, Lt. 
Jones, tad been co-director of a youth employment program of the Syracuse "^ifeus- 
ing" Authority in the early 19i^)'s. The Hancock Base itself was no newcomer to 
youth programs. SYS had used^he Base as a workjs^e in a previous similar pro- 
gram. * 

(E) ' These organizations and individuals have not used this experience, ktiow- 
ledqe, and networks to become conservative. They have used it to becomd more 
innovative. Though these organizations and individuals are established, they 
are no^gpfestablishment". They continue tp seek new programs, new solutions, 
and are open to experiment and change. > ^ * ^ . * 

For instance, Phil Shugar of the Pittsburgh prime sponsor, is close to the 
director of 'STAY, Fred Monaco. Nevertheless, he feels. from the prime sponsor's 
perspective, that STAY is a good program, but it is not perfect.and needs to im- 
prov^ (especially in supportive services and better -targeting) . Ha. is also de- 
' termined that STAY avoid what he considers the serious mistake of resting on 
its laurels. Similarly, Betty Lou Snapp of the Albuquerque Public Schools (APS) 
is not satisfied with the status quo. After developing the THE program with 
YETP money, she now urges APS to take over THE so that YETP money can be used 
to fiind other demonstration projects. ^She is now planning a ^program to take ad- 
vantage of the current construction boom 'in Albuquerque by teaching students 
newer construction occupations (e.g., air conditioning installation). 

(F) The development of this local infrastructure and Ibcal networks that smooth 
the way for effective implementation represents a major change from the pattern 
described in the implementation literature on programs of the. I960' S/. and early 
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1970' s. A common theme in those ^studies was the implementation difficulties 
caused by local actors. At worst local actors were found to resist innovative 
federal designs and programs. At best/ even when they sought to aid implemen- 
tation, local actors were found to b^lacking in sufficient resources a'l^or 
abilities to make it work. 

• By contrast, our finding of the^se local infrastructures and networks 
means that local conditions and actors now tend to provide ah extra 
^ boost .to the implementation of federal designs and programs rather 

than an obstacle. • ^ 



(Vli) YEDB^S EFFECTIVE IMPLEMENTATION ^"^IN A VARIETY OF SETTINGS 




• We found that within the pattern of effective implementation of these 
nine prqgrams there is a^ good deal of programmatic, geographic, and 
socio-economic variation. 

It, occurred, in different types of YEDPA programs and in different typ^ 
of cities. The nine include two" YIEPP -programs- (a Tier 1 and a Tier 2) , two 
YCCIP programs, and five YETP programs. The nine include sdWe cities that 
are large (Baltimore, San^Antonio, Pittsburgh), medium (Newark, Portland, 
Syracuse) , and medium^ to small (Albuquerque and New Haven) . There are some 
Eastern, western and southwestern cities; there is, a 6ity with a small , minority 
population (Portland), and cities with high minority populations (Newark, San 
Antonio and Baltimore), and even variation within that category (black and his- 
panic) . One has a relatively large middle income population (Portland) , and 
•others h^ large lew income populations (Newark, San Antonio) . And finally, 
there i-s a good deal of difference in the economic bases of these cities. Of 
o£ this is no accident. One of the goals of our program selection 



\ course, all o£ 
tfaa^to pg63uce 



p pgcauce these variations . 

' The nature of our data and analysis is such, of course, tKat no systematic 
conclusions or even tests can b^rformed because of this variation.* ^ 



*lndeed, while there is significant variation in ^hese categories, even xf 
the nature of the data and analysis 4ere more systematic, there are not enough 
cases in each category to permit sigriificant testing. 



-.7 

However, effective implementation j>f--rfiDPA in such a variety of set- 
tings is significant because it gives a. rough indication that the pos- 
sibilities of effectiveness are not limited to any one type of program 
or city. It also generates a broad base of data, albeit larqs^ im- 
pressionistic. 




(VIII) WHAT REPORT DO^ AND DOES NOT DO 

We can tell the Task Force much about — * ' 

• How to improve the implementation of these programs ' • 

• How to avoid implementation failures\ 

For the reasons noted below, we cannot tell the Task ^orce with full con- 
fidence how to produce ultimately effective outcomes from youth employment 
programs . ^ . ^ * 

We analyzed the effectiveness of the implementation of these nine programs, ^ 
but not their ultimate outcomes. Of course, our ultimate goal is^ policy that 
has effective outcomes ; one. whose effect on the target population is positive; 
. one that tends to art^eliorat^e that social problem in ^response to which it yas 
created, or at least creates som^ positive change in it; To achieve this goalv 
in addition to being .adopted effectively and then implemented, effectively, it 
must be first a good policy, with a design appropriate to the problem.* As 
Pressman and Wildavsky have argued, "A fast train is worse than a slow one if 
it takes you in the Wrong direction." (Pressmen and WildaVsky, 1973) Or as 
Bardach suggests, "'Good' implementation cannot by itse^/^of fset the ill effects, 
of a 'bad' policy design any more than a more perfect compass and straight 

o 

edge can help us square the circle." (Bardach, 1977) 

• Thus, effective implementation is a necessary element to achieve an ef- 
fective outcome, but it is not sufficient in itself. ^ 

Why then does this study focus almost exclusively on the element of imple- 
mentation? First, to analyze the conditions and factors associated With effec- 
tive outcomes, we must be able to measyre the outcomes (the effects of the 
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program on^ its participants). However, thes^ nine YEDPA programs are so rela- 
tively new that there as yet has not been enough time for the program to have 
measurable effects on a large number of participants. (All had been in their 
YEDPA operation less than eighteen months at the time of this study, June 1979). 
But on the whale, the^e nine YEDPA programs have been impilemented more rapidl^s 
than usually is the case for most social programs. Thus, placement data (one" 
indicator o£ outcomes) are scarce as yet. Moreover, simple placement data do 
ntJt in themselves yield definitive conclusions about outcomes. They are shaped 
or "contaminated" by factors other than program effectiveness. These otliter fac- 
tory especially include the tightness of the local laboj Inarket and other environ- 
mental factors. For instance, even in the absence .of training programs, youths 
constantly are moving in and out of the labor market. Thus, without control 
groups it is difficult to definitively attribute how much of the placement rate 
is a function of the program and how much would have occurre'd ih its absenc^* 

In focusing almost exclusivelyCrTijnplementation , we are able t^say less 
than we would .like to. But we are interested in action rather than pure social 
science and thus reject the alternative of saying more, but have to Wit .to t^o 
so until the -outcomes are fully discernible and" measurable. Because^ of this sgoal 
of :action we cannot afford the luxury .of applying only the highest methodological 
standards.*' Confronted with research ambiguities, the policy analyst cannot af- 
ford to remain agnostic and passive in the face of pressing social problems. (In 
our first recommendation below- we will discuss further this tension as described 
in Hargrove's research on how DOL tried to deal with it in the previous adminis- 
tration. ) 

.o second, of the three major elements re quired for an effective outcome- 



*Even if it were not contaminated in this way, outcome data that is cur^ ^ 
'rently collected by those monitoring YEDPA programs for DOL often ^ends not to 
be useful. For e&amplev MDRC's data on "Reasons for Termination of YIEPP Youth 
does not permit distihctio'ns between positive and negative termination. Instead 
as a single category of analysis it identifies terminations dueto youth having 
"grad^iitiTor dropped out" (emphasis ^added) . Similarly, MDRC pfisents another 
category labeled "voluntary resignations" without explaining whether this might 
tend more to bl positive or negative. "Monthly Statistical Summary of Youth 
Ent:^eisfint Demonstration". May 1979^, Table Q-4. ^ 
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an effective design^ effective adoption^ and effective implementation — 
presently the most difficult one to achieve is effective implementation . 

It is ±he element on which domestic Social policies most frequently founder . 
Indeed, in the past decade or so, problems at the ' implementation stage have 
►been the largest souri^e of social policy failures and this is predictable, - 
When impliaxientatioh depends on many actors, as it must in our^heterogeneous 
society and pluralistic political sygtem^ there are numerous possibJ.lities for 
disagregnent and delay . 

j ... ^ 

\ Tables 1-15 illustrate how' this pattern applies to YEDPA. They indicate 

how the multiplicity of participants and perspectives in a YEDPA program com- 
bing to produce a formidablQ obstacle cov;rse of policy implffnentation% 

o In short, these obstacles to effective ^implementation are generic to 
social 'poiic^king in the U.S. rather than limited to youth employ- 
ment programs. This is the lesson of the broad range of case studies 
wKich we reviewed from outside this area^ 

» \ 

There is a table for each of the nine programs'. Each table lists the 
major decision points that determined the course of Jthe program gnd had to be 
passed 4b order for the program to continue. The participants in each deoi- 
si^oneurealso listed. For simplicity we make the admittedly unrealistic as- 
stimption that each decision iK>int is independent of each other\ Tal)le A svuranar-^ 
izes all nine programs. 





TABLE A 

POINTS OF DECISION AND CLEARANCE NECESSARY FOR COMPLETION 'OF EACH Qf THE 
NINE .YEDPA PROGRAMS: THE MULTlPLICm OF PARTICIPANTS, PERSPECTIVES, AND 
AGREEMENTS THAT SHAPED THE COURSE OF EACH PROGRAM. 



Program 



Decision . 
Points 



Participants 



Cumulative Total 
of Agreement ' 



Pittsburgh's STAY • 


10 - . 


39 


50 


New Haven's VICI 


. .19 


22 . 


m 


Portland's EHR 


JL5 


13 


31 


Syracuse's bOCES-HANCOCK 


13 ' 


12 


46 


Albuquer^e's THE 


11 


98 


119 


Albuquerque's WORP 


8 


6 


23 


Newark's IHS, 


- 12 


20 


33 


Baltimore's YouthWorks 


15 . 


408 


446 


^an Antonio' s YCCIP . 


9 


13 • 


22 
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TABLE 1 



PITTSBURGH 



Organizations 

Student Training and Assistance for Youth (STAY) 
Select Employment Trainee (SET) 
Alternative Vocational Education Readiness Training (AVERT) 



Actors 
Fred Monaco 

Phil Shugdr 
William Bowes 



Title/Position 

Project Coordinator of Student Placement Section 
Director' of Project STAY ' 

Prime Sponsor 

Assistany^Dir^ctor of STAY 



TABLE 2 



Points of Decisiort and Clearance Necessary for Pittsburgh's STAY 



Decision Points 



1. Request for proposal sent out by 

' the Prime Sponsor- to organizations 

interested in a YETP for in-school 
youtH. (Fall of 1977) 

2 • Proposal returned to the Prime by 

Monaco of Pittsburgh Public Schools. 
(Fall of 1977) ^ 

3. Proposal accepted by the Prime in 
principL^ but vith a number of re- 
servations. Prime wants to negotiate 
the p^posed salary of FSA's, the 
eligibility requirements of partici- 
pants, and the student-staff ratio. 
(Fall of 1977) , 

4. Negotations are held between Prime 
and schools .over the issues detailed 
above. At the end of the negotations, 
the scorecard" reads: salary settled 

^ in favor of schools, eligibility re- 
quirements and student-staff ratio 
settled in €avor of Prime^ 
(Fall ^^^'^'^^ 

5. Project STAY is given: final approval 
b:^ the Prime . (December 1977) ^ ' 

6. Monaco hires an assistant program 
"Operator anci 13 Field Service Aides. . 
' ( Jamary^ 1978) 

7. Thirty-five public sector^ worksites ^ 
are contacted and 'enrol led in^ Project 
ST^Y. Cuanuary 1978) 

8. Recruitment begins for STAY. t^Che re- * 
Ofuitment i^ 'conducted byvthe'FSA's 
suid after some initial difficulties, 

50 youths are enrolled. (P€i>ruary 1978) 



Participants 
Phil Shugar 



Cumulative Total 
of Agre^ent 



syient 



Monaco 



Monaco/Shugar 



Monaco/Shugar 



shugar 

Monaco/Bowes 



Monaco & 35 
worksites 



10 



FSA'S 



46 



47 



40 



Table 2 (cont.) 



Decision Points 



9. As the program nears its final weeks 
of its first semester, Monaco contacts 
the 13 FSA*^ from SET/AVERT and asks 
to give the highest priority to 
the gi;aduates of STAY in their (SET/ ^ 
- ^AVERT PSA's) job placement efforts. 
(April \l978) 

10. As the problems with the STAY become 
more severe, Monaco decides to hire 
a full-time currictilum developer. 
This necessitates negotiations with 
he Prime. (June 1978) 



Participants 

7 . 

Monaco 



Ciamulative Total 
of Agreements 

48 



Monaco/Shugar 



50 




TABLE 3 



New Haven 



Organizations 

Corporation for Public & Private Ventures (CPPV) 
CETA (Prime Sponsor) 
Carpenters Union 
Paintei^ Union ' 

Human Resources Administration (HRA) 
.Neighborhood Preservation (NP) 
JJew Haven Redevelopment Agency 
Regional Rehab. Institute (RRI) 
Neighborhood Housing Inc. (NHI) 



Work Providers 



Regional. Office 



Actors 



Department of li^abor (R/DOL) 
Title/Position ^ 



Tom Corso 
Tom Peterson 
Sally Connolly 
Al Rogers 
Lou D' Antonio • 
Sal Monarco 
David Saldibar 
Frank Perelli 
Tom Laugeni 

Ed White 
George Musgrove 
Stephen Darley 
Mike Catania 
Robert Jackson 
Stephen Whetstone 
Pat Tisi 
Gerald Tirozzi 
Mark Barbarino 
John Kelly 
Lane Smith 
David Newton*^ 
Judy Andrews 



CETA Director 

Planner in CETA 

Program Director for Ventures 

Assistant Director for Ventures 

Budget Department - CETA 

Carpenters Union Representative 

Carpenters Union - Business Manager ♦ 

Business Rep. of Paintei;'s Union 

Vice President of Painting & Decorating 

Contractors of America 
Executive Director - New Haven Housing Authority 
Human Resources Administrator 

Executive Director - Neighbqrhopd Housing, Inc. 
Deputy Director - New Haven Redevelopment Agency 
Office of Neighborhood Preservation 
Director - Regional Rehab Institute 
Energy Coordinator in Regional Rehab Institute - 
' Superintendent of Schools 
Director of Adult Education 
CPPV Representative 
CPPV Representative 
Ctounselor - Ventures 

Counselor.- Ventures * ' 
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TABLE 4 



Points of Decisio.n and Clearance Necessary for New Haven's VICr Program 



Decision Points 



Cumulative Total 
Participants of Agreements 



1. Selection in New Haven of people to write 
' proposal (Corso wanted people that he 

trusted and knew would do the best job 
possible) . (May 1978) 

1 

2. Negotiation with Central Connecticut 
carpenters, Local Union No. 24. 
(May- June 1978) 

a) Un^ns would establish criteria 
for worksites; 

it 

b) Union would provide safety 
instruction; ♦ 



Corso, Connolly 3 
Peterson, DiAntonio 



Saldibar (union) , 
Connolly 



c) Union personnel would be hired 
as crew chiefs; 

d) j Program would not take work away 
* from union; 



e) Union would provide criteria for 
training program; 

f) Advisory Council would be established 
including representative of union Vnd 
council wpjald h^ve, access to all re- 
Cords and ^r.eports;* 

g) Union representative could sit on 
interviewing/hiring committee. 



Connolly, Saldibar, . 
Peterson, Corso 
(involved in decision 
re: hiring committee) 



Negotiations with brotherhood of painters 
and Allied Trades of America Local Union 
No. 186. (May-June 1978) ^ 



Connolly, Perrelli 
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Table 4 (cont.) 



Decision Points 



Participants 



Cumulative Total 
of Agreements 



- a)' Agree to sit on Advisory Council? 

b) Agree to give preference to ventures 
graduates for apprenticeship ppenings; 

c) Program would not conflict with labor 
or \mion policy. 

4, ^^^tiation^ with Painting and Decorating 
Contractors of . America. (May-Jvme 1978) 

a) Unions woulS establish criteria, for . 
worksites; 

b) Union personnel would be hired as 
crew chiefs; 

c) Program would not take work away 
from \inion; 

d) Agree to sit on Advisory Council. 

.5. • Negotiations with Housing Authority. ^ 
{May-J\ine 1978) 

a) Housing authority would provide 
worksites to program; 

b) Projects must be within one of the 
four target areas; 

' \ 

c) Projects will represent "non- 
contract ible*' work; 

d) Projects {pinust meet community de- 
velopment needs. 

% 

6. Negotiation with Human Resources Adminis- 
tration. (May- June 1978) 

a) HRA would provide at least three 
projects to program^- Prince Street 
Schoolv Davenport Library and Ivy 
Street School; 



Connolly, Laugeni 



Peterson, White 



20 



Peterson 



24 



\ 
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Table 4 (cont.) 



Decision Points 



%\iinulative Total 
Participants . of Agreements *" 



b) Projects must be within one of 
four target "areas; 

c) Projects will represent "non- 
contractdble" work, that is, work 
not ordinarily contrac^d to unions; 

d) Projects must meet community de- 
, velopment needs . 

. )' 

7. Negotiations^with Neighborhood Housing, 
Inc. {May-June 1978) 

a) NHI agreed to use at least one crew 
from the program for rehab, work; 

b) Project must be within one of four 
target areas; 

c) Projects will represent "non- 

contractible" work; 

d) Projects must meet community develop- 
ment needs. 

8. Negotiations with New Haven Redevelopment 
' Agency. {May-«June 1978) 

a) NHRA agrees to provide worksites to 
program; 

b) Project must be within one of four/ 
target areas; / 

e) Projects will represent "non- 
contractible" work; 

d) Projects must meet community develop- 
ment jfieeds; ' 



Peterson, Darley 



28 



Peterson , Catania 



32 
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Table 4 \(cont.) 



Decision Points 



Participants 



Cumulative Total 
of Agreements 



9. , Negotiations with Office of Neighbor- 

hood Preservation. (May- June 1978) 

a) N.P. agrees Xo provide worksites 
on trial basi^-if satisfied with ' 
quality of work, supply will be 
increased; ^ 

b) Project must be within one of four 
target areas; 

c) Projects will represent "non- 
contractible" work; 

d) Projects must meet community develop- 
^ ' ment needs. 

10. Negotiations with Regional Rehab. Insti- 
tute. (May-June 1978) 

♦ 

a) RRI agrees to supply worksites to 
program. Work to be done will be 
weather izat ion work; :^ 

b) Project must be within one of four 
target areas; 

c) Proje^^s will represent "non- 
conltractible" work; 



d) 

r 



Projects must meet community develop- 
ment needs. 

11. Negotiations with NevrHaven Public Schools. 
(May-June 1978) 

a) Agree to supply program with part- 
^ time instructor to teach blue print , 
reading and -trade-related mathematics; 



b) Provide GED instructor. 



Peterson, 
Jackson 



36 



Peterson, Whetstone 



Peterson, Connolly, 
Corso, Tirozzi 
(superintendent) , 
^Barbarino. (Director 
of Adult Ed.) X 



40 



42 



ERiC 



46 



^3 



4it 



Table 4 (cont.) 



Decision Points 



Participants 



Cumulative Total 
^ of Agteements 



12. On-s^te visit by CPPV Representative. 
(J\ine 1978) 

CPPV essentially reiterated most of 
the agreements made with unions and 
work-providing agencies. ' Approxi- 
mately 38 — not included in tot^l , ^ 
because they arfe not new agreements, 
merely confirmations of exisjting 
agreements*. 

13. CPPV approves proposal. (June-July 1978) 

14. - R/DOL approves — signs contract — money ^ 

released. (Sept. 1978) 

15. Hiring carpenter crew chiefs. 
(Summer 1978) 

a)— Saldibar does initial screening 
within his union? 



.15 

Included CpIpV 
^ep\ Connolly, 
Peterson, 
DiAntonio , Cor so 
and all the Union 
anS Work-Prpviding 
Agency reps. 




43 
45 



Saldibar, rep.* from 57 
CEtIa Personnel Office, 
Rep. from Work-Providing 
Agency 1 



b) Hiring committee then decides out t 
of the applicants — unanimous agree- 
ment on all. 

16. Hiring painting crew chie^. (Summer 1978) 

a) Laugenni does initi^ screening 
within his union; 



Laugenni , from ' 66 

CETA Personnft Office, 
rep. from Work-Prqviding 
Agency 



^FTririTig committee then" decides — 
unanimous agreement on all. ^ 

17. Selecting Program Director. (Sept. 1978), 

a) As it turned out, it was a non- 
decision decision. The procedure 
consisted of submitting an appli- 
cation for tjie position. Cprso 
wanted Connolly to run program. 
Everyone in CETA believed that 
she would get ^e job. No one 
else applied. 



Cor so," Connolly 



68 



ERLC 



47 



7D 



Table 4 (cont. ) 



Decision Points 



\ 



Participants 



Cumulative Total 
of Agreements 



18. Hiring Assistant Director. (Oct. 1978) 

Agreement to increase salary for l:hat 
position. ;As it stood' originally , 
assistant director's* salary was less 
than crew chief's salary, (One of 
the union people (forgot which one) 
said that director's salary had to' be 
higher. It was agreed. ^ " - 

7 ' 

19. ^ Hiring counselors 

a) Counselors were referred to program 
by CETA Personnel Dept. David Newton 
started before Sally^ was chosen as 
director, so the only interview was 
within CETA. (Aug. 1978); 

b) Judy Andrews was hired after Sally 
so she was interviewed both within 
Personnel Dept. and by 1sally> 

> (Oct. 1978) , 



Laugeni , Saldibar 
rep., from Work- 
Providing Agency 



'70 



CETA Personnel Dept. 72 " 



Note: Total (72) does not ^include preliminary negotiations and decisions at DOL 
with respect to., the VICIC demonstration ift general. ^ ^ \ 



48 



ERIC 



oC 



TABLE 5 
PORTLAND 



Organizations ~ — ^ 

Human Resource Bureau (HRB) ° 

Office of Planning & Development (OPD) 

Portland Development CommissSon (PDC) 

City Council ^ 

Bureau of Buildings 

Associated General Contractors (AGC) 

Carpenters Union 

School District 

Portland Community College (PCC) 
CETA 



Actors 



Title/Postition 



Neil Goldschmitt 
John Pendergrass 
Charles Jordan 
Ron Anderson 
Don Staudenmeir 
Will Nevmian 
Don Silvey 
Marv Rasmussen 
Gary Tuck 
Bill' Hadley 
Bob Olson 
John Ries 
Leon Johnson 



Mayor of Portland ^ 
Former Youth Career Training Coordinator 
Former Director of Hximan^Resourbe Bureau 
Head of Associated General Contractors 
Head of Local Carpenters Union 
First Program Director of Emergency Home Repair 
Housing Manager in Portland Dev^opment Commission 
Director of District Pro.g£ains, Portland Public Sefiools 
Youth Employment Coordinator — Portland PubLicr'bchools 
Ojoerations Specialist — Youth Career Tr^iffting Division^ 
Second Program Director 
Present (3rd) Program Directo 
Former Head of Youth Ser\£iee Division 






TABLE 6 



Points of Decision and Clearanq^ Necessary for Portland's Emergency Hoip Repa ir Progra^ 



V 



Decision Points 



Participants 



Cumulative Total 
of Agreements 



Mayor decides* to have youth program. ^ 
(Summer 1974) ^ ^ , ^ 

Mayor requests that Pendergrass write ^ ' 
proposal for youth program* ^ 

Pendergrass submita propo^al^'to Counci-1.' 
(Sugimer 1974) 



Council votes-nSianimously to accept pro- 
posal a;idfall 'but one councilor vote to 
pass^t on emergency basis, because of 
:hat one vote, funds canpot be dispersed 
for 30 days. 

3. Pendergrass lineg up staff. (Summer 1974) 

4. City Council passes ordinance ^to waive 

' building permit feear. (summer 1974) * ' 

Per ordinance, Bure/ku of Buildings will 
issue building, permits to EHRrcrews'^at 
no cost. 

> 

5. City Council passes ordinance^ that Of ^ce^ 
' of planning and Development will earmark 

a portion of their HUD community. 
(Summer 1974) 

Office of Planning and pevelopment 

6. Charles Jordan (Human Resource Bureau) 
approaches AGC for their endorsement. 
(Summpr 1974) 

a) AGC agrees to support program? 



b) AGG agrees to provide technical 
assistance; ^ 

, c)'' Jordan agrees that EHR will not 
take away work from unions. • 




r 



Mayor, Human 
Resourc^ Bureau, 
^Pendergrass I 
{Youth Cai 
Training Office) 

Mayor, 
^ City ^Council 



Pjefidergrass 

City Council, 
Bureau of 
Buildings 



City Council, 
OPD, PDC 



Jordan, AGC 



3 
4 



/ 



50^ 



Table 6 <cont.) 



Decision Points 



•Cumulative Total 
Participants of Agreements 



0^ ^7^ AGC bifings" in Carpenters Union., 
K (Summey 1974) ^ ' . 

a) ^ Carpenters Union agrees \o support* * 

prpgranf; « . ■ ' 

b) Agrees to provide technical assis- 
tance;* * " ^ 

c) Agrees to^j^ovide prografh with union 
journeymen/ » * ' 

d) ^ Agreement that EHR wilJL not perform 

union wojrk. 

(» 

8. Agreement tq award academic credit. 
' ( Summer 1974) 

- 4 

School Distriqt agrees to award^academic 
^ credit >to in-school you^ who ^fticipate 
. in program. ^ o ' ' 

9/ "Program Director is hired. (Summer 1974) 



10. Agreement wijih Portland Community College. 
(Summer 1974) 

Portland ^Icjmmupity College agrees to supply 
program wi4;li a shof) -teacher. 

11. Program is c6ntrac|:ed out^to schools. 
» (Spring ol975) ' ' • * 

^ . V ^ I ' • . 

a) Sdhool District agrees to-^run program; 

b) ' School District agrees to provide ' ' 
\ ^n^eria]* and 'fiscal support j 

^ . • ' * <» ' 

c) ^School District agrees ^to hire and ^ 

• supervise * ins'tructbr ; • - * 

d) School District agrees to provide * 
♦ * buiiaing to' house progreim's head- 

^ ^ quarters, , • ' , 



AGC, City, 
cfarpenters 
/union 



13 



City and Schopl 
District 



City and Directo^ 
> (Newman) 

C4.ty and PPC 



City (Hum^ Resource 
Bureau), District 
School 



14 



15 



16 



20 



Table 6'(cont.y 



Decision Points 



Participants 



Cmnulative Total 
of Agreements 



,i^2. '-New Director is hired. (Summer 1975) 

•Betause of personality conflict between. • 
** director and ^outh services personnel, 
it was decided'^by City and School Dis- 
" * trict^ that when school took over pro- , 
gram/ a new director would be brought, 

13. c^rogram encounters ^administrative ;dif- 
^ficulties resulting in administrative 
^ overhaul . (Wintet 197,7) . 

a) Accountant is hired — establishes 
fiscal cor^trol system; ■^'^ 

, b) Establish formal criteria for 

job description for prograri ^ 
director; 

^ >^ , f " 

' c) Old director decides not to apply; 

d) New director is hired; 

e) Purchasing is centralized and made 
respojisibility of project coordinator; 

t 

f) Formal criteria for screening ^ 
established. 

14. Replacement of Crew piiefs. (Winter 1977) 

a) Tensions created by procedural 

changes. Attrition and; favorable ' 

- - climate for construction led to 

staff turnover 'among crew^ chiefs; 

' H b) Carpenters, Union was approached for 
replacemenlf personnel but they had 
no mor^ to supply;' ^ 

c) School District supplied program with 

- shop teachers to work as cr^ew chiefs! 



City School 
District, AGC 



21 



City<5 School 
Distridtr AGC 



City, School 
District, AGC, ' 
Carpenters Union 



27 



30 



52 



ERLC 



81 



.< Table 6 (contj 



Decision Points 



Qumulative Total 
Participants of Agreements . 



15. Establisti a Skills Development curri- 
culum. (Spring/Summer 1979) ^ 

• a) * All of the aetors cited are^^pi^- 
'Sently yorking on. a curriculum 
^that will aid in providing par^i 
cipants^with the necessary skills 
of the craft and monitor their 
. progress. * 



Program Director, 
City, School ^ 
Carpei:iters Union 




31 



4t 



r 



X 



-53 



* TABMI 7 



Syr( 



acuse 



• Organizations 

Air National Guard (ANG) 
Syracuse Youth^ Servi6e (SY£ 

Office of Eederal & State rad Coordinator ^ COFSAC) 
Urban League . 
Board of Cooperative & Educational Services (BOCES) 
Regional Office - Department of Labor ~(R/ROL) 



.V 



Actors 



Ralph Jones 
Major 'Purple 
Major Hall' 
. Andy Willis 
Lee Be^t 
Mike Tierney 
Terry Dolan 
Joann Coria 
Ann Michel 

Jim Brower 
^ettsy ^rt6n 
1 Lieutencint Butler 



TiJ: la/Position ^ \ 

Lieutenant - Air National Guard - Syracuse 
j4ajor - Air National Guard - Syracuse 
Ma jorj - Air National Guard - Syracuse 
Birector of Urban League - Syracuse 
Directior of Syracuse Youtii Service 
^ Manpower vPlannii>g Director in OFSAC 

Operations Supervisor - Syracuse Youth Service 
^ Counseling Supervisor - Syracuse Youth Service 
' Former Director of Of f ice -of Fed'eral and State 
Aid Coordinator 
Directprsof Adult Education Services - BOCES 
BOCES teaaher 
' Base's CE^'ta Liason vOfficer 




54 



X 



86- 



TABLE 8 



■ A, 



Points of Decision gnd- Clearance Necessary for the Implanentation of 
Syracuse's BOCES-Hancock Program 



Decision Points 



Cumulative Total 
Participants of Agreements> 



1. • Decision to have program at Base. 

(Sixmm^r 1978) 
♦ * * * • 

2. Attempts to start program with 
Urb;an League . (Summer 1978) 

. • No agreement - Base would have to % 
pay kids directly and get reimbursed. 
Base does not have funds. 

3. Decision*' to have program with SYSr.^ 
(Summer 1978) ^ 

a) Agree that Base^ will train kids 
in various shops at Base; 

b) Agree, that city (SYS) will pay 
youths ; ' 

c) . Agree that there wil\ be 5^ 

' renedial education component 

d) Agree that Base will supply 
"transportation . 



Jones, Major's, 
Hall & Purple 

Jones, Willis 
(Urban League) 



Jones, Hall, 
Pvurple, Best, 
tpiemey, Etolan 
Coria ' 



4. ? Ann Michel of OFSAC endorses program. 
/ (Summer 1978) . 



Michel 



10 



Jonee brought Ann Michel to Base emd 
showed *her a yputh who was working in 
• one of the shops. * She was very im- 
pressed amd gave her support for the 
program. 

5. Bringing BOCES- into program. (Sept. I^IQ) 

BOCES agrees to supply program with 
teacher and materials* for $21,0^0. 



SYS' (Dolan) 
BOCES (Bowen) 



«9 , 



12 



^ Table 8 (cbnt.) 



Decision Points 



6. Hiring teacher (Sept... 1978) 

BOCES coordinator hires Bettsy Burton, 
who haA just finished working in another 
BCX^IS program, to teach youths at Base.' 

.7. R/DOIj approves program (Sept. 1978) 

8. '^Major^, •'Purple and HalB arrange to keep 

Jones on Base (Fall 1978) 

9. Recruiting supervisors (Sept. - Oct. 1978> 



Jones spoke to guardsmen individually to 
solicit their participation. At least 1() 



agreed to participate, 



A 



'Cumulative Tc^tal 
Participants of Agreement^ 



10. Jones receives transfer to* Washington, D.C. 
Majors requests th^t.he select a successor 
(Nov.^ 1978) 

y.. Jones picks Butler (Nov^ 1978) ^^"^ 

Majors agrees to ask Butler to run program 

12. " Butler is chosln (Nov. ^978) 

* ^Lt. Butler, who was in Officer's Training^ 
School in Tennessee, agreed to run the 
program. > 

13. Majors arranges to keep Butler on Base 
• (Nov. 1978) 

Paperwork is filed to re^ceive^ additional 
active duty days for Butler. 



en 



R/DOIi 

Majors, Purple, <■ 
Hall 

I 

Jones and at least 
20-Xither guardsme^ 



Hall, Purple, 
Jones 



Hall, Pxirple, 
Jones, Butler 



Hall^ Purple 



13 



14^ 
16 



39 



40 



44 



46r 



TABLE 9 



V 



Albuquerque's THE 



^Organizatipns 



Jourism Hospitality Education (THE) 

Albuquerque Public Schools (APS) ^ • T ^ 

Office of Comprehensive Einployment and Training Act> (CX:eta) 



At tors 



Bettie Lou Snapp 



Carlos Duran 



Russ Rutledge 



( 

Title/Position 



'^sistant of. Director of Vocational Education 
(Home Economics) 

Youth Coordinator, Office of Comprehensive Employment 
' Training .Act (OCETA) 

; President of Albuquerque Inkeepers Association 
Counselor for THE 



.TABLE 10 . . • 

Points of Decision and Clearance Necessary for Albuquerque's THE 



Decision Pbints 



.Participants 



Cumulative Total 
of Agreements 



1. Carlos Duran asks APS to submit a proposals APS , 

for the 22 percent of YETP money that must be Prime Sponsor , 
spent in accordance with a signed agree- 
* ment between LEA and Prime Sponsor. 
. - f 

2. Bettie Lou Snapp oJl AES contacts President Snapp,. President 
of Hotel/Motel Association about her "hotel of Hotel/Motel 
idea". ' ^ 

3. President of Hotel/Motel Asspci^tion i^orms. Five hotels, 
Snapp that five full service hotels will President Snapp . 
participate in her program for a training • 

fee of^$io,000 per hotel. ^ , 



2 



4. Snapp submits the plan to the OCETA. 

/ ' " [ 

5. ^ Pi;lme Sponsor likes the proposal in^ prin- 

ciple but' objects rather strenuously -to the 
training fee. Prime Sponsor asks Snapp to 
renegotiate -the training fee. - 

6. Snapp informs the President of the Hotel/ 
Motel Association of the problems with the 
fee.. The President agrees to approach the 
five hotels- about a lower fee. 



7. S^app, J^cesident. of Hotel/Motel Association 
and representatives of the five hotels 
agr.ee o^ a set fig\ire of $^5 a, week for •the 
training-^^ee. 



Snapp 

V 

Prime Sponsor- 
-Snapp, Presi<^nt 



Snapp, Resident 
5 hotels 



8. Prime ^Sponsor approves the new revised, plan - Prime Sponger 
and gives the go-ahead for THE. . ' ^ 

9. Snapp hires the staff for THE^ cOnsiisting Snapp ' r - 
of a teacher/administrator and a dounselOi:. 



11 



12 
13 

15 



22 



23 



24 



\ 



Table 10 (cont.) 




Decision "Points 



10. Rutledge contacts the guidance counselors 
^ of the nine high schools participating in 
THE, explains the program, and asks their 
help in recruiting participants. 



""lOa. Recruitment is forced to make a 
, return visit to the guidance / 
counselors and reexplain the pro-* 
gram* to them.- 

; 

sixty students are finally, enrolled in THE. 
But in order to do so, THE nsks the 'PriirL^.:, 
for permission to allow 15 petcent of THE 
participants with family ii\^omes between 
70 and/80 percent of the DOL\s' lower living 
standard,-to enroll in the program. The 
Prime gives ^ its permission. 



11, 



Participants 



QimulativG Total 
^f Agreements 



3^ 



Rutledge & (90) 
guidance counselors 



Rutledge & the 
guidance counselors 



Prime, THE 



117 



118 



119 



r 





TABLE 11 



Albuquerque^, 



Organizations 
OCETA J 

APS * . ' - 

WORP' ^ . 

MDRC (Manpower Developtient Research Corporation) 

University of New Mexico 

Kirkland^ Air Force Base ^ 



m 

V 



Actors 

Carlos miran 
Jack Kaemper 
Dennis Contreras 



Title/Position v 

I 

Youth Coordinator for Office of CETA (OCETA) 
Albuquerque Public SchocHs (APS) liaison with OCETA 
Director of Work Opportunity Research Program (WORP) 



Points of Decision and Clearance Necessary for Albuquerque's WORP. 



Decision Points ' ^ 

1. Preparation of Application or YIEPP grant. 
' 2. selection of Entitlement Area. 

^ 3. Agreement on worksites at University of New 
Mexico and Kirkland Air Forc^\^se. \ 

4. Agreement to adjust Schedules of entitle- ^ 
menfe youths. 

5^ Agreement to provide WORP bus. 

6. Agreement to include New Futures School 
in Entitlement Program. 

.7. Agreement to hold GEO class . at vocational 
/institute. 

8. ^ Agreement t^add support service staff- 



J ' Cumulative Total 
Participants of Agreements 

OCETi^, APS 2 

OCETA, APS, MDRC 5 

OCETA, APS; UNM, 9 
AFB 

Contreras, Romero 11 



WORP, Duran, MDRC 14 / 
W 

Contreras, Kaemper, 18 
Duran 



APS, Contreras 



20 



Contreras, OCETA, 23 
MDRC ^ 



60 



ERJC 



92 



TABLE 12 



Newark 



Organizations 

Independence High School (IHS) 

YouthWork, Inc. ^ , t 

* 

Regiona*! Department^ of Labor (R/DOL) , , ^ 
Mayor's Office of Employment and Training (Prime Sponsor) 



Actors 



Harry Wheeler 



Dan O' Flaherty 



Title/Position 

Director: Mayor's Office of Employment and Training' 

c « 

Youth Coordinator of Mayor's Office of Employment- and 
Training 



61 



Points of 



Dec ision and Clearance- Necessary for Newark's IHS 



Decision Points 



Participants 



Cumulative Total 
of .Agreements 



\ 



1. 



2^ 



4. 



5. 



Prime sponsor's office jLnforms IHS of ^ 
the competition being «>nducted by 
Youthwork for.DOL fuo<||ng-^oY In-School 
Exemplary progranfe t/h6lp youth avoid • 
vinemployment. Prime/asks . fqr proposal. 

IHS submits proposal which is largely . 
a description of the IHS progpm tihat 
was reorganized .in 1976.^ ' 

Dan 0' Flaherty receives the proposal ^ 
and tells IHS thdt he is' af raid Jhat- " " 
IHS would not be funded by YoutHiork 
and that IHS will hav^di^f iculty 
with the work experiente paft 9i£ the 
program. - ' ' *' ' ^ . 

IHS is notified by YouthWork . that they 
have qualified for the final competition. 
Youthwork makes a site visit to IHS.. 

' IHS is notified that they have been 
selected by YouthWork to participate ; 
in the In-School Exemplary |i?>agram. ^ ^ 
IHS receives a grant of $289)0^0 from ^ 
Youthwork. ' 

school opens and after three-week 
orientation, the student body is 
divided in half. Appro;cimately 45 
students begin academic instruction, 
and 45 begin their work experience. 
. The wbfk experience necessitates / 
Placing 45 Jtudents in 3°^^ they ex- 
pressed some interest in. Thus -ap- 
proximately 45 employers must be 
found for these students. 



Prime S|>onsor 



IHS 



0' Flaherty 



Youthwork. 



Yolithvtork 




6 



62 
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Table 13 (cont.) 



ion "p^j] 



Decision Points 



Participants 



Ciamulative Total* 
of Agreements 



7. IHS is contacted by YouthWork and 
informed that the work experience^ 

' as presently constituted is illegal. 
After day-long negotiations in- 
volving IHS, YouthWork/ Prime Sponsor, 
DOL, RDQL and Congressman Peter Rodino, 
IHS agrees^ to change its work eljcperi- 

^ ence which will necessitate asking its* 
private sector employers *to pay ope- 
half of the wage bill of students. 

, 8. iHS contacts its (approximately) 15 
private sector employers and informs 
them* of the change. Surprisingly,- 11 
agree, to the change. 

9. After eight weeks of wording, 45 .stu- • 

dents return to IHp for eight weeks 

of academic instruction. Thus, 45 

new joBs must be found, for the stbdents 

who were at academic instruction for 

*• ~ * -> 

the preced|.ng eighjb weeks. 

10. IHS is contacted by the Prime Sponsor 
^oncerninjg the eligibility of some 
studfents. , Prime inform^ IHS that in- .« 
eligible students must be removed €ran ' 
DOL support:ed^-»'rt=7vw»«« ? 



IHS, RDOL, DOL, 
Prime Sponsor,' 
Peter Rodino, 
YouthWork 



^IHS 
15 employers 



IHS 



Prime 



12 
% 



28 



29 



30 



11. 



enroll stu- 
family income^^ in excess^of 



permission 



IH$ asks 
deiit^ 

85 pQ^ept of DOL' s lower liyihg stan-' 
darjf. Having rea^ ^SedpA regulations, ^ 
IH6 'llnew^th^t ^suc)i*'''fi^^ .fcould^" be ' V 
^^^anted by^'DOL ii^^^the; Primet^lagr|e<I. The* 
-friifte resta^'d'lts»-4p^ir|t a^^out; r^oving . 
IHS 5»students "'from ?X)L ^pported ^activi- 
ties.. *S ' ' • . ' * \ f ^ • 



iil 12. ipS' dmands a ^ meeting, witji ]Rr4in^ over ' 
^ ^ eligibility, issue. Pr^c^; Insists tf>jii(t 
• ^ ' youthWprk\ be present^ at **the me^ting^ 
. At * the meetiiig Prime accedeVato^ IHS/s 
request, If YouthWork has no oi^f^-^^^^-- 



63 




.95 



IHS 



•31 



IHS, You^ljjjork' 
l^ime 



A 



33 



•A 



TABLE 14* 



Orqar^zation^ 
MOMR 

.Manpower Devej-ogment Resource Corporation. (MDRC) 
Baltimore City-Sch'ools (BCS) , . 



J. 



Actors 

Marion Pines 
Robert Ivry. 
William Schaefer 
Thomas Bradley 
James Keck 
HenryV Snyder 



Title/Positjqn , o v ' ' 

, Director of Mayor's Office of M4n^)owe* ' Resources ^(MOMR)^^^'^ 
^ou^h Services Manager of MOMIV, ^ ' - * • 

Mayor of B^timore * , / . ^ \ ' 

, AFL-CIO Representative , v . . ^ ^ ^ 

Director o£ YouthWorks . ' ^ * 

' Head of the Ramsey Conference • ' / 



n;V^6 ^nn .n^ Clearance ' Points kec-essarV f or ' the Im p lem ental fion -of fealtimofe's ■ - 

Eptitlemeht Program " ^ . \ \ ^ • 



• / 
i 



V ^ CuifiMlative^Total/* I 



Participants. " of ^Atrrejaments' ^ 




3. <%Bl^tion oJ^EhtiUement -Area. , \y 
• ' (^ ' , . ' . ^" ■ .■ 

' ■ > iA!' AgrS^ht to subcontract with LEA fou^^ 
I'f alternative education programs and in- 

' . < • • ' iSKftiool 'administration. ; . 

'^^^ 5\4 Agreement to subcontract >itK CBO's 

for alternative ^ucation. - 

^ : ' \ - e. Agreement of AFL-CI0;to supped the*. ^ 
' * program. 



nam 



ro 



V. 



CBO'S (3) 
Tom Bradley 



15 



- / 



64 
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Table 14 (cont.)" 



\ 



Decision Points 

7. ^Agreement to pay wage differential 
ito city employejes supervising youth. 



8. Agreement of large businesses to 
provide worksites. 

9. Agreeio^ent of smaller businesses to' '* 

provide worksites. ^ " 

v 

i 

10. t Agreement pf city department heads 
y ' to provide* worksites. 

11. Agreement of CBO*s and non-profit 
organizations to provide worksites • 

12. Development of MC^ task force to V 
examine difficulties of YIEPP imple-' 
mentation. 

13. Reorganization .of Entitlement Program. 

. 14. Siibsequent reorganizations, 

15. Elimination of Ptiblic Service E^iploye^s 
frpm service delivery and staff expan- 
* sion. ^ 

' > ■ - r 



Cumulative Total 
Participation . of AgreemQj:its 



MOMR, Civil 
Service Comm. , 
Labor Comm. , y 
Union Rep. 

Hank Snyder 



300 individual 
businessmen 

City • department 
heads (15) - 

Organ«ization 
.heads (100) 

Pities/ Ivry 



19 



20 



320 



335 



435 



437 



Pines, Ivry, Keck 440 

Ivry, Keck ^ 442 

Pines, Ivry, ' 446 
Keck, MDRC 



65 



ERIC . . 



S 



4 



Organizations 



TABLE 15. 



San Antonio 



MAUC 

Housing and Ufban Development (HUD) 
Community Services Agency ^ (CSA)* 
Neighborhood Housing Services (NHS) 
Texas •Employment Commission (TEC) 
Six Catholic Churches 

Building and Trade Unions of San Antonio 



Actor 



Title/Position 

# _>*Juan Patlan Executive Director of Mexican American Unity Council (MAtC) 

A ^ ■ . ; ■ ^ 

" Decision ^and Clearance Points Necessary for the Implementation of MAUC's YCCJP 



lecision Points 



1. Decision to ask MAUC to submit a prop6sal 
to HUD. )r 

2. MAUC decision to apply for HUD grant and ^ 
preparation of preliminary proposal. 



3. HUD selection of MAUC. for grant award. 

♦ 

4. Agreement to provide worksites for 
YCCIP. 



Cumulative Total 
Partic/ipants ' of Agreements \ 



HUD 



Patlan, MAUC dept. 
heads, MAUC board \ 

HUt> 

Churches, lopal 
school district, 
city dept. involved 
in NHS 



4 

5 
8 



5. Ag?:eement to^ provide worksite super- 
visors. Wage and working conditions 
approval. 

6. Union agreement to write letters in 
support oi YCCIP. 

, V 

7. Texas Employment Commission agfee- 
misnt'to certify youths. ■ ^ 

a. ^ fCSA agreement to allow venture capital 
funds awarded to MAUC's community 
developmertt department to be used for 
YCCIP weatherization project » 

9, Decision to reorganize YCCIP and hire 
a new director. 



Union ^representatives 12 
?(4) 



Union representatives 18 
(6) • ^ 



TEC 



, CSA 



i Patlan and MAUC 
Board 



19 



20 



22\ 
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=^ . ' ' COMBINtljG ANALYSIS' AND RECOMMENDATIONS: , ' ^ 

HOW THESE PROCESS WRKED AND "WHAT DO WE DO ON- MONDAY?" . v** 

The rfecomffiendations thjs repqrt are empirically grounded. They do not 
represen t our wishful thinking or an effort to engage in broad social theory . 
Rather they are specif icj<0,ly based on our analysis of these nine YEDPA programs 
and secondai:y' analysis o^ earlier studies for OYP .*^ ' ^ ; 

Since they are empirically based, these^ recommendations' also should indi - 
cate to the reader the ftctual conditions 'that we found contributed to effective 
implemen tation in thes^'nine . They are, hpwever, written in the format of recom- 
mendations rather thai|' as descriptions to make them more useful to the following 
audiences who want answers to the question: " O.K,, this is how jfchose prpgrams 
^ worked and why, but vjhat do we do on Monday? " 

(1) Program Operators : ^ ' ' 

(a) ^s an aid^ ta^thoke A^ho will be initiating 'new proigrams; 

(b) as an ai<j to those operating ongoing programs and who seek to reassess 
and improve them, 

^ - ' ■ . 

. (2) Analysts in l/PTFYE, DOL and Congress who are drafting : ' j 

' *'(a) * f utyrej'lyquth employment legislation; . ' . , 

(b) technical assistance "how to run programs" guides. 

(3) OYP ahd E^TA policymakers who are making allocation decisions : 

, , « ' ♦ ' '• ^ ^ 

(a) where and in what type of programs should discretionary funds be 'put; 
; • ' ' 

' (b) what proportion of total funds shpuld b^ srlloted to such discretionary 
allocations. 



* See references cited above, p.l 
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OUR RECO^!MENDATIONS: 

(I) FOCUS ON THE IMPLEJ!ENTSMQN STAGE 



• That YEDPA policy makers, program operators, and et/eryone in between 
focus a disproportionate anvount of their attention -sCnd'-resources on 
implementation stage of these programs. ^ v ^ , 

For some, such as OYP under Robert ;r^ggart, this will represent a conto^nu- 
ation of their already significant effort* at process (gvalUation. Indeed, this 
study. benefited greatly from the process evaluation studies previously undertaken 
at the, request of OYP. These formed significant buildin'g blocks»for our analysis 

(A) Of the three^ major elenents required for an effective outcome*~an effective 
design, effective adoption, and effective impl^entation— presently the most dif- 
f icult one to achieve is effective 'implementation. It is the element on which 
domestic social policies most frequently founder.^ 

For most of them, the allegedly simple, technical. details of implementation 
cannot be successfully completed. We must start with effective designs, for YEDPA 
programs and we 'have started with them. Bui these designs wii; not be put into 
. practice nor will the policy have an effect on the target population unless it 
is implemented effectively. j 

Qirrently there are many^ good general ideas for ameliorating^ social problems 
and ;there are 'many good specific policy designs. But the legislative successes 
(the adoption stage) of yesterday have often become the implementation problems • 
of today. Since the mid-1960' s it has become much easier for*good policy. ideas 
to traverse the adoption stage without*\najor alterations. , But many /Jf these 
good ideas, which in turn become laws, were , implemented ineffectively and thus 
could not create effective outcomes for citizep.. Their liJ^eafentation was ^ 
either (a) inordinately delayed, or (b)^ it required e:^>enditures far beyond what 
was necessary, or (c)^ there was an alteration and/or " underaChievement of the 
policy's objective^; or some combination of the three. • • , 



*By an ef f^tive po^^cy outcome vie mean a policy whose effect on the ±ar- 
g-et population- is positive and tendg to ameliorate the social problem in re- 
■ sponse to whiciiNit was created. , r ' ; , ' , 



Indeed, in the past decade or so, problems at the implementation stage , 

have been the largest source of the' type of policy failures that we noted in 

our des^iption of the New Town In-T^wn program, the EDA program in Oakland, ^ 

and. California's community mental health services! These failures prevent 

participants from benefiting from a program and also tend to undermine gen^ 

* • 
'eral political support for such programs. If the implementation stage can * 

ajpid such f'ailures, then not only will there be better delivery of^ policies 

to citizens but also increased political support fpr such policies^ 

• In short, policy designers and administrators can no longer consider 
implementation as someone else's problem . ^ ^ 

Of course, if implementation becomes more effective yet there are weaX 
policy designs, outcomes will remain ineffective. However, there seem to be 
a sufficient number of good ideas and i^lacy designs around today, especially 
in the manpower and employment areas. 

(B) We also recommend giving more attention to the implementation stage in 
order sensitize policymakers, especially those drafting legislation and , 
allocating scarce federal fundp, to the essential role of* implementation in 
creating effective outcomes. There is ample evidence that most of the in- 
creased lip service paid to implementation in the last few years is just that. 
The belief tl^4t implementation issues are relatively insignificant and are 
someone pise's problem remains firmly grounded in many otherwise astute policy- 
makers and policy analysts for several understandable reasons. 



First, as Bardach suggests, "Implementation issues often seem to be of 
slight practical consequence alongside basic theoretical or political issues 
like, 'Do we really want to treat heroin use as a ctime?* or •How much should 
we spend on exploring outer spacJe?* or 'Who should bear the financial burden 
of national health insurance?' Also, implementation issues tend to come up 

0 

(when tl^y do come up) toward the end of ^n analytical process, •when profes- 
sional and J political investments in resolutions to mpre t>asic issues may al- 
ready b^^ln pl.ace and are very resistant ^o being disturbed by 'mere' consider- 
ation^ of impldnentability. People who insist on raising these issues at this 
stage'^r?sk b^ing called small-minded or being acfcused of defeatism or conspir- 
ing j»±tK the oppositions" (Bardach, 1977) ^ „ 
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Second, the recent emphasis on policy evaluation seems to have unwit- 
tingly made the analysis of policy implemerftation seem relatively insignifi- 
caat . Since the idea of system^^ic evaluation of policies took root in 
Washington^ in the early 1960's, it has contributed much to the improvement 
of ^both. policy and its analysis. But one of .the negative consequences of 
this otherwise salutary change, in outlook is^ a tendency on the p^rt of some 
to ask about a program~"Does it work?" and expect primarily' a "Yes" or vno" 
Answer. ' «- • 



• . In the following sections (especially III-V)|.we will indicate that 
programs like ►YEEJFA, which require relatively complex joint action, 
do not simply "work*' or "not work". .^Jf/en if they have a good design, 
it takes mUch effort'to make them work. Progr^s do not ge t imple- 
mented automatically; they have to be put together piece by piece. 
Certain conditions will impede the working of a program despite its 
\^ good initial dfesign and other conditions are necessary to put a good 

design into operation. \ 

• A major goal of this report Ts Wspell out the latter set of condi - 
tions in the approximate form of an impressionistic model . 

• In some instances, the design of the program itself can create prob- 
lems for implementation. Even with good local administration, the 
implementation process may founder'on excessively complex pro- 
gram design. This means that where possible (as in YEDPA) there 

' , should be an effort to maintain simple and modest , program designs • 
(see section X^) . When the program design has become excessively^-— 
complex and has other problems, actions must be taken in the imple- 
mentation process to compensate for and repair these design inade- 
quacies*. (Section IV and X will detail these actions.) 

Erwin Hafgrove's just completed study of DOL's efforts und^ the previous 
administration to evaluate CETA in 1974-75, indicates both of the abo^ reasons 
for flighting linplementation at work. Among other things, Hargrove found that 
the economists^ of ASPER (ifie office of the Assistant Secretary for Policy, 
Evaluation and Research) tended to discount the perspective of what Hargrove 
calls the political and bureaucratic people In the rest of the department. 
Hargrove found that the ASPER economists wanted^^ almost to the exclusion of 
all else, a study 4:hat.woul4 -measure the impact half of the evaluation: what 
' percentage vof trainees got and kept good jobs. ^They were n6t concerned with 
what Hargrove call§ the process half of the question: the factors that 



/ 



explained why some cities' programs were working better than others. The 

reason, Hargrove reports, is that while the fir-st task wqs suitable to their 

* ' * 

quantitative economic models, the latter was not. "Their methods, as ecQ- 
nomertVicians , did not permit them to easily suggest how to link process data 

to findings ^out impact Therefore, - their energies went into safe- 

guarding the .methodological correctness of the, plap." (Hargrove, 1979) 



(II) IMPLEMENTATION : 
PITFALLS 



COMPLEX PROGRAM ASSEMBLY AND A PROCESS OP AVOIDING 



More specifically we recommend that these actors become sensitized to 



the ^ue nature of implementation. ^ 4 * 

First, effective implementation does not occur automatically. Rathe r, 
it is a complex process of program assembly* It requires joint ac-» ' 
jbion in order to achieve the full and necessary assemblage. ^ 



< Second, major difficulties will almost always characterize the pro - 
cess of policy impiementation, especially if the policies are even 
mildly innovative. Implementation is a process, of avoiding pitfalls . 



The following sections will detail these two elements*, 



V 
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(III) PROGRAM ASSEMBLY ' • . ' 

Program assembly should be viewed as^ involving the following general 
elements . ' 



(A) Numerous act'oirs are ;Lnvolved in the program assembly process . (We shall 
refer to both organizations and individuals as **atctors".) ' 

, ... ■ . 

This is true even^f programs with relatively straightfdrward ^design 
auch as YEDPA. The tables in the introduction which listed €he pbints of 
decision 'and clearance necessary for program completion clearly indicated 
this. A general list of actors for a local YEDPA prqgram ineliidesi most* of the 
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following: The local pro<3ram itself and 'its staff, the prime sponsor, the 
larger political entity and its leaders (e.g., the Mayor), the schools, the 
unions, public sector worksites] private -sector worksites, CBO's, and posty~ 
program employers. Often DOL and Regional DOL (RDOL) are also relevant 
actorg as well as intermediate bodies like YouthWork, qPPy, MDRC or HUD. 



Table 3 gives a specific list of actors invp'lved^n' one of ouryine 
programs , New Haven ' s' Ventures . v ' ' • ^ ' 

(B) These' actors have significant interests whic h are -largely independent 
of each other and independent of the YEDPA program and/ or of- the prime sponsor 
and its larger poliltical entily . ' Moreover, most of these actors are independ- 
ent of each oiler's control even when both are in the public sector. . 

. ' In Newark, for -example, Iiviependence High School (IHS), the prime sporjsor 
' (Mayor's Office of Employment and Training). ^and YouthWork were all strangers 
"to ea^h ^er'n^~Miy^78r-W^etob-er^^ 
each. other quite well but still held independent agendas: IHS remained ^n 
autonomous, alternative school mainly interested in helping disaffected youth. 
The prime sponsor was mainly interested in avoiding any hint of fraud or mis- 
application of funds. YouthWork was a private, non-profit organization ad- 
ministering DOL's Exemplary In-School program, mainly interested i-n seeing all 
of their projects succeed. Ml three organizations became involved in negotia 
tionsi over joint action concerning whb would pay for 'the work experience com- 
ponent (and how much) and income .eligibility requirements fpr participants > 

In Albuquerque's THE program, the prime 'and the schools had worked to- 
gether before. Bu^ the* hotels, which were the worksites and the entire fpcal 
point of the program, had no prior relationship with either thejprime or the 
schools. The hotels agreed- io participate only after some rather hard,bargain 
ing between the prime, .the- schools and the hotels. The schools originally of- 
^ fqred each hotel $10,000 for participating in the program. The prim? rejected 
r the fee as being far too generous. The schools and the hotels and the prime/ 
finally agreed on a figure of $75 a week.^ ) • ^ 
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Finally, in Baltimore, representatives of large businesses (The Ramsey' 
Ctonferfence) backed- the ^intitlement program and pledged supp^ and worksites. 

• But at the site, these employers we^e not quite so cooperative. They wanted 
to be able to^make their own selecljion of youth employees and generally were , 
not tolerant of behavior problems/ They offered less -in the way of training 
it the personal level of supervisor-to-youth n:han. did "ma and pa"' stores. In- 

'de^, ultimately the Baltimore program shifted its enphasis in private work- 
site deve^ppfltent to the small business sector.. ^ 



(IV) SUCCESSFUL PROGRAM ASSEMBLY: A STRONG E5^CUTIVE, THE OMIATION CJF INTEREST 
^ .CONVERGENCE, AND SECURING IT DOWN TO THE' WORKSITE ^) 

Successful program assembly should involve ythe following jslementb; 
(A) The program assembly process will not run by itself. It, has ^o be put 
together piece by piece. It should be guided by ^ strong executive, which means: 

- ^ i K s t, ±1^ ^ecutiv^_should4iave-en^gh power^t-o operate.' So^wd, he mrst p ursue 
tjie following actiolis: Actors and interests haVe tp be^cajoled, convinced, and 

. pervaded into joint action. Adjustments and adaptations have to be made. Co- 
alitions have to be built. .... 

' - The Syracuse program offers two examples: The selection x^f an able pro- * 
qxaxa operator, w^s key to th^program's success'. Lt. Jones, the 'originator of 
the conception, was the ob^^ioOs choice. However, Air National Guard reguia- t 
tions prevented this. Jon^s would not hav^ become the program's executive 
, if the Base commander had not intervened to make adjustments and adaptations. 



Jijjhen Jones Yikd to leavjg .Syracuse because of an Air Natiorial Guard- trans-'^ 
ter, wi^e selection of a program executive was again require<|. This time'.** ^ 
Jones ckrefully provi(»ed for the selection of an able feucces3or. He reviewed'- 
the qualifications o^ many potential candidates and therr, found one that was 

' not only ^trong but whom he- personally knew. Jones thTn .took steps 'to aid 

^ ' ' I* ' 

the transfer of this AN^ officer f rem -^fennessee to Syracuse. 
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in San Antohio, Patlan,'.the MAUC director, created a coalition behind 
his program by developing support, for itsfrom the Six Parish Coalition (a 
group previously' formed by activist priests to organize barrio residents) 
and from local construction ^ unions. * These parishes aided YCCIP by helping . 

'with ^epruitment of youth, individual homeowners, and institutional clients. 
MAUC staff were permitted to speak at parish gatherings to explain YCCIP and 
sol-icit participation.^ The church buildings themselves provided MAUC with 
som^ o^. its earliest worksites and also paid for materials. This enabled 

'/crews to be -put 'to work rapidly at the program's inception. Indeed, one 'MAUC 

/.criteria for selecting areas within 'Ihe city to receive YCCIP service was 
whe.ther^it had an active.^ parish. The unions provided supervisors for the 
YCCIP .crews and apprenticeships. for program, graduates . (The incentives that 
* Patlan in tutn was able to offer the parishes and unions will, be described in 

* the next sect.ion.) 



/ 



(B) :. perhaps the most important strategy f or effective program assembly is the 
'creation"^f"aTp^rrrofJ^t^erest convergence among the relev ant actor^-irhrough 
the development of complementary incentives . • ' , • 

*Th4^ program executiye first must identify the interests of .relevant ac- 
tors. -He should be mindful that they will be most likely to respond posi- 
tively to the program if they are of fered 'incentives rather than pleas to 
altruistic motives or authoritativS declarati'ons , formal rules, or regulations. 

• The executive should distribute incentives' that will lead these actors 
into a pattern of intere'^t convergence : one in which t^hey will find 
their interests and the interest of the YE DPA program in convergence. . 

» V I 

The use of complementary incentives^ can help create this. , Since dif- 
■ •'' ferent' actors and organizations often have divergent interests, in- , 
centiVes to; create program assembly must focus on tjie points at which 
these various objectives converge. 

• in the ideal, t)iere are points ^t which^he. achievement of these ob- 
jectives is highly interlocked: ' situations in which while achaevmg 
one's own objectives, foe actor a lso contributes to achieving the ob- 
jectives of another actor . . , : , ( 

For inst^ce, we found that 'in' the two YCCIP programs and in Portland' s. EHR, ♦ 
the work-providing agencies could not receive the free .labor that they sought 
to increase their productivity without simultaneously providing the YCCIP 
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program with worksites. This is a striking .convergence, but tfhere were 
Several other 'instances of similar^ c^o^vergence through' complementary in- 



cejitives 



In New Haven, VICI needeci genejcal support from the carpenters arid* ^ 
V paintei:3 unions / specific aid such as providing ^supervisors for VICI crews 
and apprenticeships for Vlfcl graduates, and a willingness> to hold in abey- 
ance their suspicions* of "another CETA program". In turn, iri negotiations 
with the unions, the ViCI program executive stressed the following benefits; 
the union would be getting a pre-apprenticeship ^ogram which would reduce 
their/ cost of training apprentices, referral service for skilled minor.ities , 
which woul4 help them satisfy affirmative action requirements, and jobs for' 

Unejnployed journeymen by hiring them as crewrchiefs- Involvement in the pro- 

/* ' 

gram' would be good public relations for the unions (New Haven was the only ' " 
N^w England city to receive a VJCI g;t:ant),. Finally, the -program would not 
be taking work away f^^i the unions because the rehab' work to be done is 
ordinarily contracted out .to honunion carpenters and j^ainters, 

\ The» referral feervic^ for ^skilled minorities was very attractive to the 
'unions. Most federal jobs^have affirmative action requirements, but the 
unidns >a3i|experienced difficulty in recruiting minorities on theit dwn, \ 
And^^r one ^^ion, having VICI serve^as a pre-apprentice^hip program wa^ at- 
tractive because it did not have an apprenticeship program, . y - 

4 

Similarly, VICI in New Haven needed worksites. In turn,/ in negotiations 

V . A 

with work--providing agencies, the program executive stltessed that involvement 
in VICI would gi"Ve them adcess' to fxee labor which would increase 'their pro- 
ductivity. The ^money -saved on labor costs could.be used to purchase addition- 
al materials and, thuS allow more work to b^ done on the individual jobs. Mini- 
iniziiag labor costs yas a powerful incentive t6 these agencies because they are 
limiued in the amount they can spend on each house; by fe'deral, state and city 
guidelines. ^ • ^ . . ' " 

lo Portland, ^he Portlarid Development Cdmmission provided worksites. In turn, 
it received crews to do work ttjat PDC o^erwise would not have been able to do 
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because of HU*D loan restrictions and an inability to find qualified private" 
contractors .willing to work for what PDC could pay/ The School District pro- 
vided a director and a" building for the program headquarters. In turn/ it 
received a vocational education program at minimal 'cost. Also, EHR relieved 
the schools of students that the conventional classroom had difficulty accomo- 
dating. Labor provided 6rew supervisors with technical assistance for training, 
skills development, and tc^l maintenance. In -return they -received a pre- ' " 
apprenticeship program, a ^vehicle for work experien(?e in the high school, a 
referral service foj: skilled minorities and jobs for^their unemployed- joufnei;men. 

N " in San Antonio, in, return for providing crew supervisors and apprentice- 
ships for program graduates, .unions were offered even broader incentives than- " 
in other cities. Unions are not strong in Sanl^ntonio and are continually 
/undercut by the cheap, jnigrant labor pool. * In negotiations with the unions, ' 
MAUC's Patlan "emphasized that. the YCCIP progr^ offered unions an opportunity 
to.£fi5i5hLJinjmJ?ali^^ 

become, a part of that po<?l. Patlan also emphasized that admitting youths to 
the unions. would inhibit the growth of skilled nonunion laborers who .could 
depress union wages. Finally, as an investor in two major (including the,Hyatt ' 
Hotel) and numero'us minor building projects, MAUC assured the unions that these 
const-ruction sites would i^i^e^ union labor** In the case of the parishes, in 
return for the aid* which they gave MAUq. the churches. themselves received^ 
significant physical 'improvements since 'they also served as .worksites. 

(C) Program assembly in a YEDPA program must be secured ^ the way down to'. 
the woFksi/te and through to the process o f job placement. Worksite management 
is a difficult tagk; it wjll not occur a utomatically. ♦ ^ ' 

■ • securing cooperktion from bureaucratic abtors and achieving the appro- 
pri'atfe Recruitments (participant^ that fit income and minority targets; 
meaningful worksites; good supervisors)' are -necessary but not suffi- 
cient steps. The program executive mus t be certain that somethiJig is 
qtfing on at theUorksiteS : the difficult' task of teaching specific 
^ skill functions must be acrfieved. 
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*ln San Antonio, this is a significant pledge because the unions are ^ware 
that without MAUC's insistence, contractors probably would Iqre nonunion labor 
for th^se projects. , ' . * - 
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All the pieces of the program must be put together -at the worksite arid 
in the classroom. 'The activity at the worksite should develop the partici- 
pants' job skills and should be relevant to future job placements. YEDPA 
programs perform* important screening and certification functions for employers, 
but even more essential are the specific skill functioijte. 

• ?The desired activities will not automatically or easily be established 
. at ^^he worksites. Youths participating in YEDPA are not easy to work 

with or train. They do nqf come to the program with many job or aca- 
demic skills and often have/not had successful experiences ^n other / 
'Skill preparation situations su^h as scl^ol^. 

' J^^\ this•shD^ld rio^e surprising since it is' precisely analogous to the 
striBet>tlevc^l management problems- that .execjatives^have in> other public orqaniza- 
tions. »*Street-ievel bureauA^ts." are of ficial's at the lower levels of tJub-^* 
lie- organizations' hierarchy wlj^'arfe in' direct contact^ with their clients, ex-^T 
ercise a gr^at deal of dispretion in mdking 'nontrivial decisions about apply-.- 
ing general rules to particular cases, and often must wOrk ^w±th very general, 
imprecise and ambiguous rules br laws. In effect they create and change poli- » 
^cies. But it is 'difficult for executives to effectively supervise and control 
J:)iese 'Officials, such as police patrolmen, teachers, social workers in 
work, lower court judges, property tax assessors, and wp^rksite supervisors and 
teachers iQ manpower jJlrograms. 

• Finally, the development of a satisfactory job placement process, may 
be the least automatic part of assembling a. YEDPA program and' re- 
quires significant and constant efforts by the program executive. 

There are numerous instances of adjustments and rei)airs made by program 
executives in order to secure program assembly down^tothe worksite and the way 
this contributed to the effective implementation of thege programs. In Pitts- 
burgh, during STAY'S first semestfer, a weak curriculum (class content had been 
up to iridivi<3ual teacher^) ' and the fact that* a majority of STAY participants 
strongly disliked school, made the two- hour after-school class a disaster with 
poor attendance. Monaco, the program executive, responded^ by hiring a full-r 
time curriculum developer to put together a curriculum that would attract and 
teach students who hated school. He also made class attendance mandatory. ^ 
The curriculum and attendance improved. Reading scores for over half the par- 
ticipants also improved, though the causal connection and significance of that 
are debatable. ' . 
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in Sytacuse there were similar improvemen'ts in the classroom curriculum. 
Lt. Butler added an interview with the worksite supervisor as part of, the 
screening -and admissions process. . The supervisors make the final admission de- 
cision which prevents their . feeling that a particular participant is being_ 
forced on them. This 'interview also' focuses on better tailoring the work to 

« 

the participant's interests as well as job market conditions-.' • ^ 

In New Haven's VICI, program director qonnolly responded effectively .to 
placement probleins. When the bleak job market for uWiort carpenters and 
painters resulted in very' limited openings in apprenticeship programs, Connolly 
adjusted and through a good deal of detail work, developed nonunion placements.' 
She- and crew supervisors also Aade..important- adjustments- when faced with prob- 
lems at the* worksites. Initially the" crews undertook many small projects to 
'achieve a high productivitir. rat^f^ifeut the skills d.evelopment comp6nent suf- 
fered, in response to external suggestions from CPPV and complaints frem crew 
supervisors, Connelly shifted J:he policy to one of bigger worksites. They in- ' 
corporated a wider variety of skilly and a higher ratio of rough work to finish 
work which also gave participants broader skill experiences. .j, ^ 



The need for attention to putting pieces together as far dbwn as the work- 
' site is indicated by the Entlllement program in general and the Baltimore pr9- 
gram in particular .■ The Entitlement program's provisions" of a job guarantee . 
and the admission of all eligible youth in an area' seem to result in less 
specific skill trajining. related to particular careers than In the other pro- 
grams. -Tfiis is because there se^m to be. more 'difficulties in Entitlement in 
getting the desired type of worksite^, ar^ sufficient worksite supervision. In 
:Baltin;^re, for example, we noted the program's worksite difficulties with 
large employers, , . ^ / \ ^ 

. now return tn hh^ det ^n.c, behind what we callpd the second miQ^ 
• element of the true nature of implemen tation. 




(V) IMPLEMENTATION: A PROC^S OF i^VOIDING PITFALLS 



(A) We recoitan^d that YEDPA policymakers assume that major difficulties 
will almo^t^lwe^s characterize implementation and that 44;^ ii^ a process of 
avoidip^ pitfalls , > ~* 

^ • They must eschew the view that good ideas will implement thefnselves 
or at least face a relatively easy Implementation process biacause 
they have good designs. . * 

• They </anno1t assume that scHneone else will consider the issue of im - 
. plementation feasibility gmd that someone else ^ill worry about the 
\^ specific steps of^prograia assembly * T 

We sp^tci^ically recommend that the major strategy for avoiding imple- 
mentation-pitfalls should be steps to anticipate them . If One can antici- 
pate^ these pitfalls,, then one will be better able to, develop ways of avoid- 
*ing them; coping with them, and/or overcoming them. 

(C) But how is one to go about anticipating them? The next dozen sections 
will suggest some ways. They are described roughly in ascending order of ' 
importance . 



1% • 

-iVI) THE BENEFITS OF PREVIOUS DIRECT OPERATING EXPERIENCE ' [ 

^ 't * 

• YEDPA designers and implementors will be better .able to anticipate 
. , implementation pitfalls if they have previously had direct operat- 

ing experience in another YEDPA or manpower or education program. 
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A corollary: We found that the separation between jilanning and implanenta- 

tion which has plagued many federal programs,* can be bridged if the program 

' ' ' \ 

planner then becomes the program operator. 

* . ' * 

The prior operating Experience of STAY ' s (Pittsburgh) director , Fred 
Monaco, seems to have contributed to effective irtplemiptation by helping. him 
anticipate implementation difficulties. Before Monaco began STAY, "he had six 
years' experience running the SET/AVERT Programs for the Pittsburgh schools.** 
He kn6w what kinds of difficulties kids were having in adjusting to work and' 
designed STAY for the type of youth who^was failing to successfully complete^ 
trie SET/AVERT Program. ' ' ' , ' , 

Albuquerque's WORP Program began auspiciously .when Dennis Contrera? was- 
recruited as .program planner. He was able to bridge the gap between planning 
and implementation. He had operating experience as director of YIEP (Youth In- 
School Employment .Program) , a work opportunitiel program for in-si:hool youths. 
He used procedures that had' worked, well at YI^EP to anticipate potential dif- 
ficulties'. For example, he built into the program a system^of ' dofcumentation 
to identify participants' arid work supervisors' responsibilities and their con-> 
tacts with WORP counselors. (In San Antojiio and Baltimore . such cle^r operating 
procedures were not part of the initial program design and significant problems 
occurred which necessitated developing them' later.) Contreras then bridged .the 
planning-implementation gap by moving directly from his position as program : 
planner to program coordinator. \ 



*ln the papt, the implementation of many programs his been made very dif- 
ficult because of a separation o^- policy design and policy implementatf on . 
'.Planning has "been done by one organization; the consequences have been f^lt by 
anoSer! Design has been done by persons at the federal level ; implementation 
Ss been carried out at the local level. Design has been done by persons with 
t a planning background who have^had no operating experienced Plannmg^has been 
done by a top executive staff; implementation has been done by persons low^r 
down in the organization's hierarchy. , • . 



**SET/AVERT are two similar programs in which in-school youth who are 
having problems with school are assisted in finding permanent par,t-time em- 



ployment . 
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Similarly, in New Haven's VICI the planning and implenentation separation 
was bridged ^when one of its original planners) Sally Connolly, became program 

She brought a good deal of expferience as youth program admiJiistrator 
and as author of New' Haven's Entitlement proposal. In her previous ope^ting 
experience she had leaned that linkages wit^h other organizations and agen^es 
had to be more than proposed linkages/ This led her to negotiate them with 
the unions^ and work-plroViding agencies even prior to submitting the*grant pro- 
posal for VICI. 

, ^ Equally important in VICI was the, prior operating experience of the assist- 
*ant director, Al Rogers, as Director of the Maintenance Divisi^sm in^ej^w 
Haven Housing Authority. In addition to his contacts in the building trades, \ 
his perspective from the field as well as from a managerial position was es-^ 
pecially helJJful with the technical- field details over which implementation 
typically stumbles and is delayed (e.g., the scheduling work for th^crews and 
familiarizing the journeymen with paperwork afid supervisory tasks) . 

4 , 

The previous experience of Phil Yourish, Newark I H?s program director, 
helped him implement an innovative prograi^. Yourish previously worked at both 
traditional and alternative high schools and had some feel for the needs of IHS 
students. He felt that their needs were better served by an intense concentra- 
* tion on basi^c reading, writing, and math skills and rejected the prior emphasis 
of IHS on raising political consciousness. 



The importance of pluvious experience is even more sharply indicated by 
thet^area in which Yourish lacked it ^d the 'resulting impleSment^ation difficul- 
ties. In his first years at IHS (and earlier), Yourish had worked in rather 
insulated and independent school settings in which it was not necessary to 
deal with other agencies equal to or higher than his school in an a^ministra-- 
tive hierarchy. This inexperience resulted in difficulties and delays in the 
joint activity with the prime sponsor for the YETP program* 



similarly the inexperience of the first director of San Tkntonio's YCCIP 
program and the consequent implanentation difficulties also indicates in a 
negative way the importance of prior operating experience. . • 



81 



ERIC 



■ ^ 



(VILI) BUIIDING AND MODELING NEW YEDPA PROGlyi^S ON PREVIOUSLY SUCCESSFUL PROGRAMS^ ^ 

The supply of persons with operating experience obviously is limited, 

even though recently it has been growing. Also, it is Visually more reliable 

to base policy strategies on institutional, impersonal factors xa.ther than on> 

personal, individualistic ones. 

* "• We- thus recommend an additional strategy i buildi^ng new YEDPA programs 
on youth programs previously successful in that locality or modeling , 
YEDPA programs, on otjier successful /programs so as to avoid continually' 
"reinventing the wheel". 



r 

New programs have many .advantages, but when a program is new, untried and ^ 
innovative, it is not possibl^o anticipate al} oyeven most of the likely im- 
plementati^on difficulties. The experience of several of the nine programs an- 
alyzed seems to indicate that building on a prior one or»nodeling it after one 
increases the ability to anticipate i m plementation pitfalls. We found that in- 
crementalism works by contributing to effec tive implementation. 

^- 

^ The first strategy seems to have been crucial in contributing to the ef- 
fective implementation of the programs in Portland, .Pittsburgh, 'and Newark. For 
instance, Pittsburgh's STAY was i^deled very closely on the school system's pre- 
viously successful SET/AVERT programs. But' it actually went one step, further - 
and was built upon these programs, enabling STAY to avoid most of the ordinary 
. implementatiorHdifficulties (e".g., the key actors for STAY-the worksites and 
the schools-w^re exactly the 'same ones who had worked together successfully on 
SET/AVERT for seven/years.) The se-^ond ^trategy of modeling on success from el.se 
where was used .effectively in New H^v6n and San Antonio. » 

" previously successful progr^s tend to be relatively scarce in most fields. 
But as we have argued, by 1979^ the quality of local manpower progrins and re- 

■ lited personnel has grown greatly. Thus,' today there are a significant; numbeiN^ 
of successful programs to serve as seedbeds o^Jnodels for YEDPA programs. 'Nev- 
ertheless, even to the eJctent that such programs exist, using than directly or 
as models may ^o^ be appropriate for the particular context at hand: the par- 
ticular city, demographic mix, or temporal context, ^r instance, as noted in 

•Baltimore, the use of the BSC administrative model for entitlement was inappro- 
priate and c6ntributed to implementation difficulties. 
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Also, it is not always desirable to build or model ^on a prior program. 
When facing difficult soc4al problems, likfe youth unemployment, innovative 
programs often must be created frbm scratch. ' Of teji this will mean developing 
a program that\is quite unlike previous ones.^ Sometimes it is necessary and 
desirable to invent a new and different wheel . To some extent the Syracuse 
program did this by .using a iffilitary base that was far from the inner city. 



(VIII) SCENARIO WRITING: ANOTHER AID IN ANtAjPATING IMPLEMENTATION PITFALLS - 

• Since it is not always possible or desirable to build or model upon a 
pri<sr program, we recommend the writing of a scenario as an additional 
major aid in trying to anticipate implementation difficulties . 

Scenario writing involves the imaginative construct^ion of; .future sequences 
of actions, the resulting conditions and reactibns, and in turn the further con- 
di^ons and reactions that are developed by all acttofs and organizations involved 
in the iipplerq^ntation process. t ^ * , 

• At its best -scenario writing should sensitize the program executive to 
*the obstacles that lie ahead. It should help him <f6velop one of the 
most important characteristics of an effective implementor — what Bardach 
has called a "dirty mind ". "The implementor with a 'dirtv mind' anfTci- ' 
pates and tries to predict implementation* difficulties. He is especialr 
ly attiined to the interests involved and their likelihQod of delaying 
and even resisting the planned implementation route*"* A dirty mind 
would have predicted the ineffective impleme^^tation of the swine flu ^ 
vaccination campaign.*** ' 

• Scenario writing brings the likely flaws and problems to thg forefront . ' 
Thus it forceg design^^ and program^' executives to try to take account 

^ . of them . It sensitii-^^IE^^olicymakers at the top to the importan^is of 
-local capacity in carrying out a successful program. 



*Perhaps because of the frequent artificial and inaccurate, distinction be- 
tween policy (politics) and administration (implementation) , we ^pe more fa- 
miliar with a "dirty mind" in policy at the -policy adoption stage. Fojr Sample, 
a "dirty mind" would have predicted that within a week after Garter's enerqy 
speech of Sunday night, Jul^ 3 Congress's ini^al positive response to hi3 
pr9p6sals would change and then be greeted with more caution and deliberation. 



**A dirty mind would have predicted the perfectly commbit delays) bufe-^n 
this case they w§re extraorcjinarily detrimental to the program^ the resistance 
or foot-dragging of* almost all the actors' including the private vendors '^( the 
drug companies), some of the HEW doctors and experts, and some private doctors. 
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• Thus scenario writing can help the program executive to predict the 
obstacles that are most likely to arise. 

Following this effort at prediction, the exeputive^will be better able to^ 

take actions to: ' * 

♦ • - avoid these obstacles- ^ ^ , • 

'' ' ' 0 

• , adapt, readjust and cope with them; - • , 

• overcome them; • » * \ ~'. 

4 

• dr some canbination of all these things. 

In scenario writing, among pther things, one must have a keen^seose of the 
political and bureaucratic terrain where the progi^ is taking place. One must 
be able to "walk thrpugh« . step-by-step all the functions involved in the pro- 
gtams' continuing -operation, all the^actions necessary to assemble the' required 
resources, and all the likely intersections with relevant political and bureau- 
cratic actors that will affect 'the process of setting up and managing the pro- 
gram (Chase) . in "walking through" the program otie must try to anticipate what 
is going to happen ^ai^especially what will go wrong.* ^ /. - 

in writing an implementation scenario one tries 'to invent plausible stori.es 
which may highlight the more obvious flaws 'of a program. For example, a good 
deal of delay iTight haVe been avoided in Entitlement programs if a scenario had 
^been written concerning its policy of 'lacademic credit for, work experience". 
Vihis has encountered significant opposition from local school officials who in- 
sisted that it was their province to decide what merited credit and 'resented . 
, "nonprofessionals" telling them, how to , run their schools. A reasonable s^ario 
' would imve anticipated tdie reluctance (eveA resistance) of educators in g5,lng 
^ along with such a policy. Thus it would have forced, program executives to try 
.to take account' of this obstacle in advance and then try to . develop adaptations' 
^to deal with> it. 

, ^compliance features, of successful grant proposals to ^-^^^^^^^ . 
ment often cont^^^n a "Workplan" which details activities, participants and time 
SLs "- sciario would go beyond this and relate the -^^^P^-^^^ f ^^^^^3!°" 
litical and bEreaucratic conditions that, are likely to surround ,these adminis 
. t aSei deUSv espe^aUy the potential obstacles ^^^^^^^^^^^ 
to face. Moreover, unlike the "workplan- ("^^^K ^r^^^ '^^^^^^^ 

J^enaS; is entirely an^dnternal document to aid the people running the progx^. 

, ' f " 
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Scehario ^ifeing is an art. \ince it requires Imagination and intuition, 
there is hot mu^that can be formkized or codified kbout^ow to do it'weil 
(Bardach. 1977)1 This is "probably a majir reason why scenario writing has not. 
'been advocated before and is rarely done by golicy analysts and designers. Also, 
scenario ^writing is an exercise in concentrated pessimism- and cre^^es psy- ' 
chologically difficult processes' to undertake and thus usually is shunned. 



Scenario writing m effect was approximated in the planning process for 
New Haven's VICI. Ne Haven's CETA director chose two people with operations 
backgrounds to writ^ the vlCI grant proposal. They developed the proposal by 
tryjing to anticipate programmatic proS^ems that could hinder implementation " 
and then tried to set up plans to>void or overcome them. - In" this manner they 
confined planning and implementation in a way that approximated the ^ocess of 
scenario writing and then acted on these predictions. For example, from their * 
previous expedience "they anticipated the need to have more than proposed link-- 
ages. Thus they negot^iated them with the unions at the outset. i 

. \ 

Un^^e almost all of other recommendations, scenario writing is not 
primarily extrapolated f^om our findings among the new programs ^alyze.d. Only 
the^^w Haven program mad^ ^approximate use of it^* B^t our^ecommendation is 
based on the findings of the-'-^eneral literature on social^^icy implementation 
and recent cases such as the swine flu vaccine program. Mom^ver, the othertj^^ 
progi;ams amt>ng the nine analyzed do" offer some empirical reinforcement for ^ur ^ 
scenari© writing reqoiraij^ndation. The absence of* systanatic efforts at antici- 
pating.and predicting implementation difficulties resulted in significant im- 
plementation problems in many of the nine. * 



For. instance, ^hen one consid^f^^-trha^^he clientele for Pi^shSurgh's STAY 
^consists entirely of youths who had severe problems in school, then it -^ouid 
have been anticipated that its .two-hour after-school class would meet with 
student resistance. A reasonable scenario for STAY would have anticipated ' 
this resistance and would have initially led to a more structured class at the ' 
^outset with strong penalties for non-attendance. This, ofL course, is pre- « 
cise/y what 'happened. But it? took a semester's experience before STAY m&de 



these changes. 
/ 
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A reasonable .scenario for Albuquerque's THE would have anticipated dif- 
ficulty, in convincirig high school counselors of the^program's benefits.^ ^HE - 
felt the program was so good that kids would flack in and did not spend enough 
time selling it to counselors or school administrators.- Thus they had to make 
a' feverish- attempt in February' of 19J8, to get the desired number of youths when 
a significant short fall) in recruiting seemed likely. 

c 

. ' For Newark's IHS the central imRlemejilation problem was th^t they did not 
^ - anticipate (1) that there would be a need ^'.e significant degree of joint ac- 
\ ^ tion; (2) thit joint action would be difficult to achieve" given IHS's previous 
history of autonomy from both the public schoo.l syst4n''and the city government. 

■ ^ Finally, Baltimore ^titlement planners should have anticipated that Public 
' ' service Employees would frequire special training/and that; they wo^ld have more 
' problenfs than a staff hired from a more marketable pool of applicants. T>ey 

also should have anticipated that, a program o^ this one's size and complexity 
' required clear operating procedures rather than the inapptopriatfe administrative 
model. of the Baltimore Summer Corps. The major reason that they did not^evelop 
these anticipatings and then act on them -^eems *o fit ^ur description above of 
the political imperatives (such as £aA<^esults).. -The^. were anxious to .beg. n 
the program to symbolize • the city go/rnment's coneern about youth unemployment 
and to satisfy DOL. ' " , • * 
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(IX) INSTITUTIONALISING EVALUATION AND REASSESSMENT MECHAlflSMS 

. A "-^^^V^^ ^nHn .^re. first, l^ hat most -jonpl^inentation difficu],ti« 

nn,nP close to being ^ee of er ror: the-tesfe-of a ^qck^ 
gg^^^J^^ prn^ram is nol ule a bsen ce of error, but the abU.^y . 
to detect, its own .errors and then co rrect them. . ^ ^ 

■ • Thus we recommend that the pro^s of anti'cipation P^^^^i^^ion and 
adaptation be institutional ize%yond scenario writing by building 
into YEDPA progrLs mechanisms f ^^Tfi^dback evaluation/ and .reassess-^ 
men? of tJe implementation. Cniere also -"^^ ^ .P-^"^""!^!^.! 
the execution of these remedies', which we will discuss m the next 



section. ) 
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In many of the.niije programs, the processes of evaltiation^ and reassess- 
ment led/to the detection and correction of serious implementation problems. 
Thus in some of these cases, what was in effect 4heir second phase was ef- 
fectively implanented, which their initial phase tended not to be. It shouW 
be noted that in all these instances* of reassessment the processes>were informal ^ 
rather than institutionalized. 

"For instance in Baltimore, after the first few months of operation, pub- 
lished reports, citizen complaints, and mayoral dnquiries mide it clear to 



Pines and Ivry that the program had implementation pfoblems. They also knew, 
that staff was. too ab^rbed in its operation to objectively analyze and evalu- 
ate them. ^ Pines and Ivry assembled a task force of top staff from other parts 
of MOMR. It worked intensively for a month reviewing operations 'and developing 
recommendations. Some ^changes Were made immediately; others followed a second^ 
reassessmerJI^ at the conclusion of the program's first summer,* These changes 
substantially improved program implementation. 

MAUC dir^Gtor^, Juan Patlan, undertook a similarly successful reassessment 



and reorganization of San Antonio's YCCI^. Responding to outside* criticisms, 
in the summer of 1918/ ^tlan in^structed bomingo Bueno, head of MAUC's family 
developnent department", to. investigate the YCtiP and prepare r^ommendations. 



, Patlan confronted the YCCIP dir;fict<5r with the inyestigatioi^^s results and in- 
^ striicted him to comply with its administrative di^^tives (e.g. , those jieeded 

to stop budget overruns and match worksite assignments with' project objectives) 
Patlan also directed his administrative assistant ,-^ervantes, to work with ^^nd 
monitor the YCCIP director. The*YCCIP director failed to comply with th^ di- 
rectives.* In September, Patlafv created another three-week investigation of 
YCCIP. With fuir documentation of poor administration before him, Patlan re- 
placed the YCCIP head with Maggie Eureste, MAUC's youth coordinator. s\e and 
her new staff "^gnificantly improved the program's implementation. 



*The major problems identified included: 1) the functional separation of 
operating divisions, 2) unclear operating procedures, 3) inadequate staff 
qUantity^and quality, 4) managerial overload, and 5) inequitable caseload al- 
location. These problems were addressed and largely overcome by: 1) realign- 
ing staff along geographic rather than functional lines, 2) developing clear 
operating procedures, 3) appointing a director whose sole responsibility was 
entitrement, 4) eliminatinc^ CETA public service employees from most direct ser- 
vice positions, 5) adding ^staff , and 6) reallocating caselqads . 
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Note that in San Antc^io as in Baltimore, the initial feedback mechanism 
was pressure from outside the prograar; Internal mechanisms did not alert MAUC's 
director to YCCIP's problfems. It was not until critical HUD evaluators gave 
the program a very low ra^ng in comparison with others that the director took 
notice of these problems. j ^ 

we di)|cuss^ed above bow internal and external pressures in New Haven's 
VICI led the prpgr3m director to reassess the balance between skills develop- ^ 
ment and job productivity. Ultimately the dii^ector decided to ^hift focus to 
larger job sites to, improve the skills deve/Lopment component which suffered 
with small worksites. We also discussed some of the problems in Pittsburgh 
with stay's two-hour after-school class. They were brought to the director's 
att^tion by the Field Service Ai<5es, who successfully recommended that the 
c^lass be improved in several ways. • . i 

As noted in all these cases/* the erroif* correction mechanisms were ^informal, 
rather than institution^ized. The. creation of serious and systematic interrial 
evaluations tends not to be in the nature of most public sector organizations. 
Thus, the institutionalization of these mechanisms probably must be created at 
an external l^el such as in the office of the prime sponsor. ^ 

(X) THE NEEl5 FOB STRONG PROGRAM EXECUTIVES AND THE PURSUZ^ DF "FIXER" 
STRATEGIES 

Detecting errors without^being able* to exedute remedies is useless and 
frustrating. Neither the program assembly nor tnfe subsequent, adaptation-com- 
pensation responses wi*Ll run by themselves. They should be guided by a strong 
executive v^o has enough power to operate/. 

# We also reconiroend that program .executives consciously ad^b "fixer " 
strategies . . 

\ . ' ' • 
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A "fixer" is a person who makes repairs and adjustments in the imple- ^ 
. mentation process to make it work. , (BarQach, 1977) The "fixer* s " - • 

adaptations cind compensation^ are designed' to protect y correct y and 
— sometimes expand his program ^ especially tfi^ough coalitition building 
and constant intervention in .administrative detail? . » 

There is always a need to compensate in the implementation process for* ^ 
omissions made at the design and adoption stages. One can never anticipate 
fully all the implementation difficulties and counter act resistance activities 
of other , actors. .In fact, some omissions were intended because the designer or 
program '(executive felt that it was not politically or financially feasible 
include the^p earlier. 

^umerous instances of each of thes^ {^articular elements of the "fixer" 
strat^^^gy were used in the nine .cases to achieve effective implementation. In 
New Haven's Ventures, job placement faced problems because it was aimed at 
apprenticeship slots requiring a^igh school diploma (or equivalent) which 
many participants did not have. When the first plartfied response — hiring a GED^ 
instructor — fell through, program director, Connolly and her original co-planner, 
Tom Peterson, responded by jumping right in to the details ®f the program. They 
taught GED instruction 'classes^ at night. (Many other actions in VICI taken by * 
Connolly and assistant director, Rogers which were described above in , other 
sections, would also correspond to several elements of the "fixer" strategy.) 



The program director's intervention in administrative detail also^seems 
have contributed to effective implementation in Syracuse. Program assembly 
must be secured all the way down 'to the worksite and no one has a more important 
role at the worksite than the supervi^orsS^ In Syracuse, Lt. Jones person^ly 
recruited the supervisors^ went around the base explaining to the guardsmen 
the objectives of the progi^, the types of youth involved, arid what would be* 
required of them as supervisors. He then selected supervisors on the basis of 
their desire tp-^articipate cii^d thlltr ability to work with minoritie.^ and 
. trou|j^ed youth. , ^ 
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' In .Portland', when the transportation line inadvertently was omitted from 
the budget,* the EHR program director took immediate compensating steps. He 
persuaded the school district to absorb that cost in^ their own transportation 
budget. In Albuquerque (WOl^) it was necessary to com^ensate^for an intended 
omissiop. TJ)e initial planners realized that it would-^be ciifficult for pro- 
gram' participants to use Albuqjierque* s small public" transportation* system, 
but they werfe" reluctant^ to piit^Sn expensive Jtransportation' item in the grant 
lest they lose out to less eoStly competitors^ , After t'hey were funded and 
began operating, counselors found many negative terminations /ccurring^e- 
cause participaats could not get to their jobs on time using public trans- 
portation. The*program director ^on approval of a rfew budget it^ foi: a 
WORP bus^y persuaxiing OCETA, the^ublic schools/, and MDRC (a privat^, research 
gi:ou]^^that was "toonitoring Entitlement for, DOJi) . . - ^ ' * ''^^ 

^> \ ' . . . ^ '^'^ ^ 

Baltimore and San Antonio's successful reassessments ahd reorganizations 
(described in Section IX) were carried out by executives pursuing the fixer 
strategy of adaptation. An illustration of successful adaptation and com- 
pensation comes from Baltimore. JKiIcevc^er Entitlement programs, MOMR did 
not fully anticipate its staff i^ needs. In addition to qualitative problems 
Stemming from its use of PSE's to supervise youths and worksites,^YouthWork' s 
staff was too small fdr such a large and complex progr^on. The contract re- 
cjuirement that 66 percent its budget be spent on participant wages and 
benefits also contributed to^OMR's initial sta#f problems. These problems 
were dealt with by MOMR negotiating an increased personnel budget;^^ to pay for 
additional staff and upgrade PSE-funded positionj^. In effect MOMR got MDRC 
to -modify the 66 percent administrative budget limit by awarding "enrichment 
grants" to meet "program needs' not anticipated in the original grant". 

The final case which reinforces our recommendation ot fixer strategies is 
a negative one. Yourish's lack of ability <^r willingness- to develop coalitipn 
support for IHS frequently caused implementation difficulties. IHS sought to 
maintain its separateness and' autonomy, especially from all public agencies 



90 V 



7 9o 



(such as the public school system and 'the city government) so ftuch that they ' 
also avoided developing a close relationship with the prime sponsof. , This 
led to some of the implementatio'n difficulties' noted • " 

(XI) A PROGRAM EXECUTIVE'S CONTRIBUTIONS AS A ''DOUbLe AGENT^' 

We recommend that prime sponsors seek program executives who can plc^y the 
role of " double agent" , ^ ~ - 

^ • Some program executives in the nine cases made major contributions to 

effective* implementation by acting as a "double agent". This role con^ 
sisted of the ability to secure joint action among various interests 
in the program 'assembly process by virtue of the executive's standing 
. and membership in more than one of the relevant camps in the implement 
tafcion ptocess . 

Too often the term linkage is used rather loosely in policy analysis, but the 
role of double agent seems to give meaning and personification to the idea of 
linkages. A double agent activates and operationalizes linkages between prg^ni- 
zations, agencies and other persons .- ^ 

• In particular, all these double agents had direct experience* with or 
access to major providers of jobs, most of which were either in the ^ 
private sector or with a semi-public agency. 

For, example, in creating and assembling the "THE" program, the hotel in- 
dustry and the Albuquerque Public Schools had to be brought together. This 
was largely achieved through the efforts of Betty ,Lou Snapp. , She was a "double 
agent" who was head of vocational training in the Albuquerque Public Schopls, 
and who^se husband was a hotel executive and leader in the local hotel industry. 

Lt. Jones conceived of and designed the BOCES-Hancock program and then be- 
came its de fapto program executiye. His positions in several of the relevant 
camps aided him in creating and then successfully operating the program. He 
was an officer at the base. "He had been active in a broad range* of black com- « 
munity affairs and once had worked in the city's Human Rights Department with 
Lee Be St. who now works in OF SAC. 
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; As an officer at tha base; Jones. was aware of its need to augment man- 
power and utilize resources that were not being used. He was aware that«4:here 
was a labor shortage at the base which could be ameliorated by bringing these 
youths there. Many^f th^ base's shops were operating at less than full capa- * 
city because their workload exceeded their manpower. The knowledge that double . 

agents Betty Lou Snapp apd Norman Watts had t)f labor shortages in the indus- 

* . ' ' 

tries th^t they Were close to also was a major aid to implementation. . 

Jones, also knew of the requirement that New York State's Department of 
Military ISd Na^^al Affairs had that the b^se become more involved in the com- 
munities and with minorities. As head of the base's Social ;Action Training, 
Program (SATP) , a race"relaty.ons program, *Jones had a special interest in a 
program that would bring minority youth onto the base . Through ^SATP he knew 
all the guardsmen and had some insight into their- attitudes toward working 
with minorities, which aided him in the selection of appropriate program s^p- 
ervisors. 

Jones' contact with community groups also aided implementation. The di- 
rector of the Urban League helped draft the proposal. SYMPAC, an organization' 
* of minority professi'onals , provided Jones with job availability information 
which helped develop marketable worksites. The Urban League a Isc^ made, aval li- 
able their counse3.ing services to program youths. 

m the Delaware County (PA) YETP (one of, the scores of programs whose out- 
side evaluations were review,ed), Norman Watts' position as a double agent (per- 
' *aps even a- triple agent) helped him to create and sustain this effectively im- 
plemented program. He was both a longtime member ot the Delaware County Man- 
power Beard (with a significant interest in youth emS)loyment problems) and the 
personnel administrator of the hbspital where the, YETP program eventually , 
started'. He became a triple agent -of sorts when he became the actual operating 
executive of the YETP program that he helped to found and/ locate in his hospi- 
tal.. ' # ' 



92 ' ^ 



ERIC ' ^ ^ . ^-^^ 



Watts' firsthand knowledge of the hospital industry^ especially its local 
labor shortage, was a major resource. His pqsition and influence within the 
hospital enabled him^to sell the YETP idea to its staff with relative ease. " 7 
Selling it to the prime sponsor was also easy because of his manpower board 
position. 

Finally, the crucial assembly step of obtaining the University of New 
Mexico (UNM) as one of the two worksites for Albuquerque's WORP was achieved 
through some double-egentry. The key suggestion that WORP seek UNM as a work- 
site came from a member of the Albuque;rque, School Board who was familiar with 
WORP from the public schools perspective. The school board member was also a 
senior administrator "^at UNM and knew both of the availability of University 
resources and its interest in participatijj<g in such an image-enhancing project. 
This double^ agent arranged a successful meeting between WORP planners and^ the 
UNM president.* * 

• In 1979 It does not seem gratuitous to advise prime sponsors to try 
to find "double agents" . The social policy infrastructure and over- 
lapping orgemizational cind personal networks have developed loqally 

so much in the past decade that there seems to have been a significant 
increase in the supply qf talented program executives in general and 
potential "double agent^" in particular. 

• Despite this. recent increase, potential program executives continue 
to be relatively^ scarce because of our limited knowledge of how to 

. • increase their supply by exogenous means . The limits this places on 
strategies built around executives will be discussed shortly. 



(XII) PROGRAM EXECUTIVES' TIES TO SOURCES OF j6BS 

V 

• Prime sponsors in particular ought to seek program executives who al- » 
ready have ti^s to sources of jobs . 

As noted, all the executives who made contributions^ as double agents^ had 
direct experience -with or access to major providers of jobs . One of the several 
camps in which they had a foot also happened to be a source of jobs. 

^ - ^a 
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0^ There are so ihany ways that monlx can X>e absorbed in a manpower pro-' 
gram before one gets to job developnfent that there is a tendency to 
forget that jobs* are essential for its effective implementation. 

Deyeloping an effective classroom component for a manpower program i^ not easy 
but it is much easier than getting good jobs for youths. . 

These executives' access* to jobs was especially significant becriuse it oc- 
curred without the expenditure of program funds. Moreover, most of these jobs 
were either in the private sector or with a semi-public age ncy whose budget 
tended to have some slack in it and were 'appropriated by bo dies quite distant 
from the program or its city government (e.g., ^the Air National Gu ard and the 
University of New Mexico) . 

-< 

« These program executives' ties pr^erably should be to priva te sectol: 
jobs . , ' - 

Private sector jobs are more likely to constrain youths in positive ways 
because someone there^ is' more likely to care if the youth doesn't $how up ojr 
"does his iob poorly. As Arnold Packer has s^id, " Public sect or jobs develqped 
for youth typically tend to be short on providing en ough of the discipline 
needed to' hold down a private sectol joh . " 

• There is a need to emphasize'^private sector jobs because they tend to 
be overlooked. Manpower programs are public sector organizations and 
are run primarily by persons who have spent most of theif careers m 
-the public sector (or academic world) . Thus if is understandable that 
program executives and their superiors are oriented toward public sec- 
tor job development. 



(XIII) EXECUTIVE TALENT IS MORE 'SC^CE THAN MONEY OR GOOD IDEAS 
■t , • , ■ 

• Our advice about fix^JsTand double agents , ^ though sound, has limits. 

• T he fixer strategy is difficult to replicate! Talent i s more scarce 
than e ither money or good ideas, especially at the executive level. 
And we have very impferfect knowledge of how to develop such executives 
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As Professor James Q. Wilson has argued:y" The supply of able^ experienced J 
executives is not increasing nearly as fast as the number of problems being ad- 
dressed by public policy . This deserves emphasis, for it is rarel^ recognized 
* as a constraint. Anyone Vho opposed a bold new program on the grounds that 
there was nobody around able to run it would be accused of being a pettifogger 
at best and ^ reactionary do-nothing at worst. Everywhere, except 'in government . 

it seems, the scarcity of talent is accepted as a f act ipf life The govern- ^'''^^ 

ment— at least publicly— seems to act as if the supply of able political execu- 
tive^ were infinitely elastic, thougji people setting up new agencies will often 
admit privately that they^j^e so frustrated and appalled by the shortage of 
talent that the only won^r is why disaster is so long in coming." (Wil»son, ^ 
1967) 



(XIV) THE NEED FOR MODEST AND SIMPLE PROGRAM DESIGN 



(A) In light of the scarcity of such persons, we recommend that the design of 
YEDPA should not rely exclusively on th§ir presence. 



• Indeed, the near necessity of talented executives to achieve effective 
implementation, coupled with their scarcity, leads' us to recommend a 
commensurate modesty in .YEDPA pifogram design and in our overall ex- 
, pectations for the> programs ' effectiveness . 

c 

• Hi 

(B) YEDPA program designs should be innovative but realistic in that they: 

1) anticipate implementation difficulties; . ^ 

2) 7 are modest, straightforward, and even simple . ' 
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(fe have already discussed what ^we mean by this anticipation^ process . ^ 

• * "*..'• 

ft Proqyam designs should be modest and simple in th a-t they maintain \^ 

f YEDPA's locus on the goals of job experience, t raining, job de- 
velopment, and placement . \ "> ' 

/By keeping to these specific purposes," YEDPA's implementation becomes 
more manageable and mor^ likely .to avoid the implementation pitfalls which 
have beset other sdcial programs since the mid-1960 's. YEDPA programs do 
not redistribute political power or create political autonomy in low income 
neighborhoods as the OEO and Model Cities programs sought to. But the nine 
^ y£DPA programs we analyzed did achieve the goals' upon which YEDPA focused. 

Effective implementation is a function, to a significant. degree,' of 
good local administration, but that is not sufficient in itself.; 
Even if and when a local program has a talented program executive, 
the entire implementation process may founder on a highly complex 
program design . It might even be said in a figurative sense that 
for every 1 percent increase in program complexity, it is likely 
that there will be a 5 percent reduction in implementation effec- 
tiveness. « . . 

The type of social programs that we reviewed in the Introduction have 
also had other design problems. Too often they, in effect, have been efforts 
to feed the horses by feeding the sparrows . The_Bube Goldberg nature of 
these programs' purpose and ilnplementation process have 'usually been major 
^ contributions "to ineffective implementatioJl and popr outcomes. Our descrip- ^ 
Spn (page 9) of the EDA program in Oakland and its circuitous design 
(subsidizing, the capital of business-rather thaa .their wage bill-on the 
promise that' they will later hire -low skilled minority persons) is a strik- 
ing .example of this. 

• "by contirast, YEDPA's desi^s basically have been rather straightfor- 
ward The bulk of YEDPA expenditures has gone for youth wages and . 
. benefits. In fact, there is a fbrmal regulation in the YCCIP and 
• YIEPP programs that 65 percent of a program's budget must go directly . 
^ - for youth wages and benefits and it Has been rigorously enforced. 

YEDPA's designs have sought to achieve th e speSfeific goals lust Jioted 
through^ Relatively straightfor ward process. 
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^For instance, in three c)f the nine programs analyzed there were two work- 
sites or less for all the program's participants.* This type of design also- 
facilitated the programs »\ day to day operation as well as its bureaucratic 
program assembler, in these programs there was a relatively limited number 
of discr,ete functions handled by ^ relatively limited number of actors (re- 
cruitment^ job supervision, teaching, counseling, placement). Tea^ching 
masonry, tor example, is^ less complex than organizing street gangs. Its re- 
sults can be more readily seen and evaluated. GED, carpentry, and painting 
requiue the mastery of specific techniques that can be measured. 

The curriculiam at Newark's IHS, especially its changes over time, re- 
flects YEDPA's salutary emphasis on modest and specific program design. IHS 
attempts to help youth develop work experience and career goals, while at the 
same time improving basic math, reading, and writing skills. IHS* failure to 
achieve these goals in its early years while it was raising students' politi- 
cal consciousness prompted IHS, under Yourish's leadership, to change to this 
more modest and focused approach. However, though modest, IHS is innovative. 
It is an alternative high school.. Unlike the public high schools it has suc- 
cessfully sought to integrate work experience with a student's education. 
For rotating 9-week periods, half of the student body participate in the aca- 
d&ad,c curriculum and the other half work in public and. private sector jobs 
obtained by IHS. Among other successfully achieved aims, this plrogram shows 
the students that school and getting a job are interrelated. \ 

X 

t 

(XV) MAINTAINING THE DIVERSITY OF YEDPA'S OVERALL DESIGN AS A NATIONAL PROGRAM 

(A) A strength of YEDPA's overall design as a national^ pir^gram seems to be the 
. diversity it encompasses. For example, the nine' programs we analyzed include 
two from YIEPP, two f rem 'yCCIP^ and five from YETP, with a good deal of di- 
ver s'ity among local program designs. 



*In Syracuse there was only one worksite — the" Hancock Air National Guardl 
Base; Albuquerque's WOI^p'^d two — the Kirtland Air Force Base and the Univer- 
sity of New Mexico; in Albuquerque's THE there was only one type of worksite — 
a full service hotel and there were five of them. ' 
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• Indeed, the flexible overall federal design has kl lowed this ..di- 
versity to develop rather than mandating it. ' * ^ . 

il> We recommend that POL continuig to allow and encourage' this diver-^^ 
sity through continuing its flexible approach . ^ , ^ • • 

Youth employment is not a siijgle problem with a single cause or a single 
manifestation. It is a constellatioit of interrelated p roblems with complex 

sources, occurring all across a large and hetero geneous nation. Thus to 

maximize effective joutcomea and learning', it seems mse to simultaneously 
allow various -policy approaches to it . It is true that this has none of the ' 
required systematic variation and-^ontrol^ of a "planned variation" approach. 
B\it there still is enough variation among local program' designs to give' us 
both broad experience and broad data upon which to base future youth progr^s. 

A specific example of the type of diversity 'that ought .to be allowed and 
encouraged Is the use of military facilities by YEbpA programs as was-done in 
Syracuse and Albuquerque's WORP. These facilities have experience in teach- 
ing job skills to youth, including those who had only mixed success in schools. 
They have sufficient organizational and resource slack to take on the extra , 
duties involved in YEDPA prografns. Furthermore, the military facilities we 
analyzed. had a special- ability to convey a crucial message about employment 
and adulthood to low income youth: Subordinatio n in an organization and -on a 
worksite is not a sign of cowardice but often a n ordinary characteristic of 
dignified wqrk . Unfortunately this is not a message that the schoofs have 
been, good at conveying. But we found that at these two base? the exposure to^ 
a military chain-of-command which involved men skilled in their professions 
(and many times having several stripes on tjieir unifoms) taking brders from 
(and even saluting) their superiors would/bring home this message to these 
youth. 

* \ 

(B) * We do not recommend that diversity be required through the maintenance 
of three of four separate programs within YEDPA. Rather, programmatic and 
local diversity should be allowed and encouraged in the specific design of 
individual programs. , ' \^ ■ 
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(XVI) SOME FINAL THOUGHTS 

YEDPA's purposes are specific and modest, but they are impirtant, even 
weighty, ^ Attempting tb.achjLeve them is a major and laudable task', alK&it a 
difficult one. * There is an old GroucTio Marx story, about two fjatien^s in a 
hospital.^ It reflects the tokenism of "too many public policy programs. One 
patient ♦says to the other, "The fdod is awful -in this place." And the- other 
replies, "Yes, and the portions are so small." ^ - ^ 

In urging that YEDPA's program designs maintain their modesty and spec- 
P ^ ificity of focus, we* are not' merely trying to get bigger portions of awful • 
^ food. Rather, we aim to f^andamentally improve the b^sic naturT of the food; 
WQ aim to fundamentally improve youth employment in the United States. >Our 
analysis of these tiine YEDpa ^prpgrams suggests, first, that in principle and 
in design, a YEDPA program can improve youth employment; second, that thes^ 
YEDPA Programs can be effectively^ implemented., We hope our reconpen<!ations 
will be useful. in suggestjing further improvements for the implementation of 
YEDPA programs. ' ' • _ ^ - 
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